-- Logs begin at Tue 2021-08-10 04:26:44 UTC, end at Tue 2021-08-10 05:39:34 UTC. -- Aug 10 04:57:11.443147 dv-cinder-803901-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 10 04:57:11.451550 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 10 04:57:11 2021] *** Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: nodename: dv-cinder-803901-2-iscsi Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: machine: x86_64 Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: clock source: unix Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: pcre jit disabled Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: detected number of CPU cores: 4 Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: current working directory: / Aug 10 04:57:11.453579 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: detected binary path: /usr/bin/uwsgi-core Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: your processes number limit is 47680 Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: your memory page size is 4096 bytes Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: detected max file descriptor number: 2048 Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: lock engine: pthread robust mutexes Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: thunder lock: enabled Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 10 04:57:11.454113 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 10 04:57:11.498597 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: Python main interpreter initialized at 0x56060fe839c0 Aug 10 04:57:11.498597 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: python threads support enabled Aug 10 04:57:11.498597 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: your server socket listen backlog is limited to 100 connections Aug 10 04:57:11.498597 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: your mercy for graceful operations on workers is 90 seconds Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: *** Operational MODE: preforking *** Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: *** uWSGI is running in multiple interpreter mode *** Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: spawned uWSGI master process (pid: 73218) Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: spawned uWSGI worker 1 (pid: 73230, cores: 1) Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: spawned uWSGI worker 2 (pid: 73231, cores: 1) Aug 10 04:57:11.502551 dv-cinder-803901-2-iscsi devstack@keystone.service[73218]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 04:57:11.499464 dv-cinder-803901-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 10 04:57:16.541924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 04:57:16.541924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: from cryptography.utils import int_from_bytes Aug 10 04:57:16.542617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 04:57:16.542617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: from cryptography.utils import int_from_bytes Aug 10 04:57:16.542617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 04:57:16.542617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: from cryptography.utils import int_from_bytes Aug 10 04:57:16.543179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 04:57:16.543179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: from cryptography.utils import int_from_bytes Aug 10 04:57:16.592796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 04:57:16.592996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 04:57:16.593193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] command line args: [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 04:57:16.593467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 04:57:16.593704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ================================================================================ {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 04:57:16.594021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] admin_token = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.594099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 04:57:16.594271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] config_dir = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.594356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 04:57:16.594462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.594549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] command line args: [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 04:57:16.594655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] config_source = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.594789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 04:57:16.594952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] debug = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ================================================================================ {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 04:57:16.595104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] admin_token = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] config_dir = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.595895 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] config_source = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] debug = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_config_append = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] insecure_debug = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_dir = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.596959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_file = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_config_append = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_dir = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.597974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_file = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.598937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.599873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.600966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] publish_errors = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] notification_format = cadf {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.601963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] publish_errors = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] standard_threads = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.602974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] use_journal = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] use_json = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] standard_threads = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] use_stderr = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] use_syslog = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] strict_password_check = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.603964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.604099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] use_eventlog = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.604177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.604279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] use_journal = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.604368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.604446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] use_json = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.604600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.604709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] use_stderr = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.604794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] use_syslog = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.604865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] watch_log_file = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 04:57:16.605095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.605840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.606985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.607935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.608983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.609929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.610911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.611867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.612934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.613922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.614956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.615877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.616967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.617996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.618982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.619917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.620853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.enabled = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.621949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.622994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.623934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.624967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.external = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.625993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.password = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] auth.token = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.external = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626601 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.mapped = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.626828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.password = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] auth.token = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.627979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] catalog.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.628939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.629507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.629695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.629782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.629932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.630919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.631978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.632941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.633921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.634895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.635878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.636989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.637945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.638910 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.639934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.640885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641348 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.641987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642703 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.642946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.643979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.644133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.644219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.644370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.644451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.644617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.644738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.645456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.645540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.645693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.645773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.645933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646087 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.password = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.646994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.647961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.648915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.649860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.650994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.651934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652408 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.652960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.653917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.654884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.655970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] policy.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.656997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] receipt.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657469 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.657945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.658913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] role.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] role.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.659858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] revoke.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.660852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] role.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661029 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] role.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] role.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] role.list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.661847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.662838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663004 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.663989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.664868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.665921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.666908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.667853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.668948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.669958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.provider = fernet {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.670927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671645 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.671880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] trust.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.connection = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.672834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.673944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.connection = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.674934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.675951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.676937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.677018 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 04:57:16.677092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.677328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.677602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.677836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.678077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.678313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 04:57:16.678484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=73230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 04:57:16.707971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.708204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.708429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.708587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.708822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.709051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.716865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.717520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.745532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.745765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.746213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.746450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.800011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.800147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.850535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.850799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.850886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.851131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.917890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918220 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.918908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.919016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.919098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:16.919237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.029941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.030033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.030159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.030243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.030369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.030453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.030597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.041572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.041901 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.054930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.055990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.056121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.056211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.056336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.056552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=73230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 10 04:57:17.073650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.073853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 04:57:17.074027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.074183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.074268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 04:57:17.074382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 04:57:17.074563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.074663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.074792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 10 04:57:17.074919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.075060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.075174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.075321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.075426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.075585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.075825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.086286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.086560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.086710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.086853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.086989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.087136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.087260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.087543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.095269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.095738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.099004 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.099279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.099513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.099597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.099792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.099875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.100945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.101955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.102221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.127579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.128356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.129671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.129947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.130475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.130784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.135117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.135506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.135786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.136029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.136426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.136708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.142907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.143185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.143888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.144170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.148149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.148431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.148711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.148989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.149113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.149356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.149439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.149633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.149716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.149899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.149980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.150164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.150320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.150447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.150743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.151012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.168576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.168852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.169557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.169837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.173340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.174367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.176971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.177367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.178018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.178417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.182381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.183568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.185931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.187135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.189500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.189792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.190085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.190369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.190666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.190751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.190955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.191039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.191286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.192102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.192383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.192677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.211115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.211395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.211660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.211918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.212389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.212673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.212941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.213207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.219706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.220954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.221378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.221652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.222649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.222962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.224809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.225084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.225369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.225657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.225932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.226080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.226372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.226689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.226987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.227264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.239083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.239360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.239636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.239913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.240398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.240678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.240964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.241245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.241442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.241743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.242034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.242825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.243122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.243414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.260148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.261616 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.263314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.264831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.266535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.268118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.268250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.270367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.270458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.270679 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.270965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.272036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.272318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.272602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.278081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.279663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.279806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.281390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.282922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.283211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.283598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.283875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.284593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.284885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.285291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.285582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.292824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.293106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.293383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.294626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.294912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.295201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.301134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.301418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.301697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.301978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.302246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.302632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.302906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.302989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=73230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 10 04:57:17.303175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.303308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.303523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.303609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.303805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.303887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.304847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.305049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.305290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.305564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.305846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.306121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.306389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.306674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=73230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 10 04:57:17.343109 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56060fe839c0 pid: 73231 (default app) Aug 10 04:57:17.345186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56060fe839c0 pid: 73230 (default app) Aug 10 04:57:17.346454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a190d-ccb4-440f-a62d-cadfdba9c409 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:17.346768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a190d-ccb4-440f-a62d-cadfdba9c409 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:17.347044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a190d-ccb4-440f-a62d-cadfdba9c409 None None] PATH_INFO: `/v3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:17.351318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 792 bytes} [Tue Aug 10 04:57:17 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:25.950566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976900-218a-4a3a-ad60-ceeccc3b3861 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:25.951096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976900-218a-4a3a-ad60-ceeccc3b3861 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:25.951096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3976900-218a-4a3a-ad60-ceeccc3b3861 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:25.956205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:25 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:25.962642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:25.963051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:25.963198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:25.993690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG oslo_db.sqlalchemy.engines [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 04:57:26.178486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG passlib.handlers.bcrypt [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73231) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 04:57:26.178926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG passlib.handlers.bcrypt [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73231) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 04:57:26.233907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:26.235561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:26.389624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:26.549535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976900-218a-4a3a-ad60-ceeccc3b3861 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:26.584095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG oslo_db.sqlalchemy.engines [None req-e3976900-218a-4a3a-ad60-ceeccc3b3861 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 04:57:26.713731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3976900-218a-4a3a-ad60-ceeccc3b3861 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:26.718101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:26.718788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:26.719078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:26.719358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:26.728016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:26.777993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.common.rbac_enforcer.enforcer [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 04:57:26.778285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceaa68-76f3-4487-abcd-0ec0d7c99592 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:26.788245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:57:26.794790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:26.808720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159a4b6-0a40-493b-a807-aad86bff2e17 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:26.813134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:26.814211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:26.814493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:26.814795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] PATH_INFO: `/v3/projects/8beb590f33a341adaea78fed778aaecf` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:26.816248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] RBAC: Authorizing `identity:get_project(project_id=8beb590f33a341adaea78fed778aaecf)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:26.869203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.common.rbac_enforcer.enforcer [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 10 04:57:26.869540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038df23c-acdc-47e3-b576-0254897ce9ed admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:26.874093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:26 2021] GET /identity/v3/projects/8beb590f33a341adaea78fed778aaecf => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:28.933015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e946b4-c249-4e2b-baeb-0a3606096267 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:28.933521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e946b4-c249-4e2b-baeb-0a3606096267 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:28.933521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e946b4-c249-4e2b-baeb-0a3606096267 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:28.938213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:28 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:28.944554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:28.944985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:28.945108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:28.964254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:28.965786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:28.974228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:28.997206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e946b4-c249-4e2b-baeb-0a3606096267 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:29.009059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e946b4-c249-4e2b-baeb-0a3606096267 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:29.013179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25db814-2785-4f99-b3e4-8a12a3aef5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:29.013799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db814-2785-4f99-b3e4-8a12a3aef5ce admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:29.014080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db814-2785-4f99-b3e4-8a12a3aef5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:29.014354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db814-2785-4f99-b3e4-8a12a3aef5ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:29.022324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db814-2785-4f99-b3e4-8a12a3aef5ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:29.024133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db814-2785-4f99-b3e4-8a12a3aef5ce admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:29.032594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:29.038900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:29.047713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0b977-c54c-47f6-881c-b9acfcb856cc None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:29.052626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc11b3c-7e5e-4354-ade5-6db02e7675d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:29.053480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11b3c-7e5e-4354-ade5-6db02e7675d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:29.053767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11b3c-7e5e-4354-ade5-6db02e7675d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:29.054045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc11b3c-7e5e-4354-ade5-6db02e7675d8 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:29.055450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11b3c-7e5e-4354-ade5-6db02e7675d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:29.057271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc11b3c-7e5e-4354-ade5-6db02e7675d8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:29.058872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:29 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:31.186637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b2c4-92b6-442c-8a8b-c41d211c5708 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.187216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b2c4-92b6-442c-8a8b-c41d211c5708 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.187216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5b2c4-92b6-442c-8a8b-c41d211c5708 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.188961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:31.195674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.196198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.196343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.215344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:31.216526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:31.224580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 6/11] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:31.243126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a66419-1b7b-49bb-956b-290794e93477 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.243416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a66419-1b7b-49bb-956b-290794e93477 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.243693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a66419-1b7b-49bb-956b-290794e93477 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.245583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 6/12] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:31.248356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.251139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.251430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.251708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.257368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82af06-66ca-40be-8b47-c0399953d4a1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.261803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.262611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.262898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.263172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.276480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:31.283331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:31.284524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 7/13] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:31.291387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.294478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG passlib.handlers.bcrypt [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=73230) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 10 04:57:31.294937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG passlib.handlers.bcrypt [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=73230) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 10 04:57:31.300817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81def9d0-14ef-4ca0-87c1-fefa68d7319b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.305229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.305887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.306171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.306446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.307248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:31.307553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:31.309320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:31.309320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:31.309320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:31.310228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:31.323950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 8/14] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:31.329894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.339979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d340bd60-734f-424b-aaca-a291a1a013bc admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.343226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:31.344401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.344850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:31.345236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.345519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.345794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.347033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:31.348843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:31.350402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 9/15] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:31.356110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.365515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be3079-266f-44d4-863a-d58191a8c0e3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.369870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.370635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.370923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.371202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.372353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:31.374021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:31.375578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 10/16] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:31.381895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.385019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 7/17] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:31.391073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9625fe6d-d539-41f6-b48f-eab781ed1cc0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.396368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.396985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.397267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.397540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.398350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.domain.id=default, user.id=ea2c6493cbbf4f86bef2484d6a25608e) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:31.398689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:31.399665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:31.399665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:31.399665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:31.400813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:31.407500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 11/18] 10.222.0.16 () {56 vars in 1344 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/role_assignments?user.id=ea2c6493cbbf4f86bef2484d6a25608e&scope.domain.id=default&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 233 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:31.407891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.417649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4accbcf-f91d-4931-ba85-f0299f991226 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.422296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e9198-1bb0-4bec-bfd2-2943ad4149f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.423327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9198-1bb0-4bec-bfd2-2943ad4149f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.423617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9198-1bb0-4bec-bfd2-2943ad4149f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.423896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e9198-1bb0-4bec-bfd2-2943ad4149f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.432972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9198-1bb0-4bec-bfd2-2943ad4149f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:31.434895 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e9198-1bb0-4bec-bfd2-2943ad4149f4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:31.445560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 8/19] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:57:31.451790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:31.462677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf921b-a33e-4f3d-821b-48232d8fbcc5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:31.467384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb1485-fc9e-4a68-8e78-e8b0213143e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:31.468196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1485-fc9e-4a68-8e78-e8b0213143e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:31.468475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1485-fc9e-4a68-8e78-e8b0213143e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:31.468749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb1485-fc9e-4a68-8e78-e8b0213143e5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:31.469935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1485-fc9e-4a68-8e78-e8b0213143e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:31.471703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb1485-fc9e-4a68-8e78-e8b0213143e5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:31.473378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 12/20] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:31 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:33.938373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2b3f-6a52-4f09-ae94-28dcba5bcc96 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:33.938900 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2b3f-6a52-4f09-ae94-28dcba5bcc96 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:33.938900 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c2b3f-6a52-4f09-ae94-28dcba5bcc96 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:33.940934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 9/21] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:33.952683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:33.953570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:33.954063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:33.980540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:33.982149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:33.996734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:34.044194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c2b3f-6a52-4f09-ae94-28dcba5bcc96 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.067957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c2b3f-6a52-4f09-ae94-28dcba5bcc96 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.072756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0a762-8466-4f9e-a106-3e84138d9cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.073571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a762-8466-4f9e-a106-3e84138d9cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.073851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a762-8466-4f9e-a106-3e84138d9cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.074132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0a762-8466-4f9e-a106-3e84138d9cc0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.097067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0a762-8466-4f9e-a106-3e84138d9cc0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:34.104212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-74e0a762-8466-4f9e-a106-3e84138d9cc0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:34.105880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 10/23] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:34.112341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.125304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56f621-7e3d-4578-88d5-07b853c6f076 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.134288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.135262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.135750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.136240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.137189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:34.137706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.143695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.151009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ea38-13bf-46a5-a41f-06b287226c81 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.151294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ea38-13bf-46a5-a41f-06b287226c81 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.151570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0ea38-13bf-46a5-a41f-06b287226c81 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.153620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 11/24] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:34.154887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 14/25] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:34.159175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.159459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.159738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.160856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.180290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5416e7-7c3b-421e-ab6f-8cf39a82d1b0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.195531 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.196773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.197258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.197750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.199363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.200134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:34.201360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:34.218437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.218437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 15/26] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:34 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:34.218437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.225684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 12/27] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:34.228473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8127a7f4-20f0-4bae-adc6-91c3ce83146d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.237789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.239506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.240071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.240657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.243658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.245725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.247782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 16/28] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:34.254158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.270899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d6f8c-f918-4910-b823-5795ee03007a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.278248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.279319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.279610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.279896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] PATH_INFO: `/v3/domains/default/users/ea2c6493cbbf4f86bef2484d6a25608e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.282419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea2c6493cbbf4f86bef2484d6a25608e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.284325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:34.284325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:34.284325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:34.286424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1eb2a-f425-4264-ad7c-65410fabefdf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.292278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.311633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca404e-3d94-4b07-a7c1-a7bf3a41348f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.322552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.323731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.324273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.324820 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.336580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.338797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.356825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-24630669-3068-4dc2-88e1-b35fa55e3d1c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:57:34.358753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 17/29] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:57:34.360483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46a348-2cd6-4602-a567-c6f1a51ecfd8 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.360974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46a348-2cd6-4602-a567-c6f1a51ecfd8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.361468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46a348-2cd6-4602-a567-c6f1a51ecfd8 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.364588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 18/30] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:34.365614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46a348-2cd6-4602-a567-c6f1a51ecfd8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.378765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46a348-2cd6-4602-a567-c6f1a51ecfd8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.444585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.445708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.446199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.446759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.447797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:34.448318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.449590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:34.449590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:34.449590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:34.450983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96f9b-eca6-438f-a1ff-4cf8cc1b7254 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.471600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 19/31] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:57:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:34.473961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.474460 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.474999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.495224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:34.497032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:34.513894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 20/32] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:34.515240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.536409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cab271-7bb3-4c5e-9ed8-cb0a2909b8d1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.541425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.542400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.543012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.543568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.544555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.545764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:34.545764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:34.545764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:34.547827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.644552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 13/33] 10.222.0.16 () {58 vars in 1383 bytes} [Tue Aug 10 04:57:34 2021] PUT /identity/v3/domains/default/users/ea2c6493cbbf4f86bef2484d6a25608e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:57:34.646404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe70f-1ed2-4048-89c3-0a10c5d83010 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.646735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe70f-1ed2-4048-89c3-0a10c5d83010 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.647026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbe70f-1ed2-4048-89c3-0a10c5d83010 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.652292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 14/34] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:34 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:34.653160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbe70f-1ed2-4048-89c3-0a10c5d83010 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:34.688498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbe70f-1ed2-4048-89c3-0a10c5d83010 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:34.704234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:34.704853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.705142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.705429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.706218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:34.708304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:34.708304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:34.708304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:34.709243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e5806e-be84-4ec8-aba2-3df616ea84e3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:34.858374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 15/35] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 04:57:34 2021] POST /identity/v3/roles => generated 219 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:34.861499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3b0c-064c-4f8c-9e91-034eb09c0762 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:34.862096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3b0c-064c-4f8c-9e91-034eb09c0762 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:34.862343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 21/36] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:57:34 2021] POST /identity/v3/projects => generated 301 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:34.862889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a3b0c-064c-4f8c-9e91-034eb09c0762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:34.890758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-467a3b0c-064c-4f8c-9e91-034eb09c0762 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:34.892872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-467a3b0c-064c-4f8c-9e91-034eb09c0762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:35.002751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 16/37] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:35.045089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:35.057846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef739659-0707-45a8-9de6-a54b7e6c9f89 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:35.071641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:35.072361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.072654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.072937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.073732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:35.075028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:35.075028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:35.075028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:35.075955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2946e1-bee3-436a-ba37-4827d1d9cb3e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:35.162302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 22/38] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 04:57:35 2021] POST /identity/v3/roles => generated 225 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:35.456689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8663f6-c2c1-408f-b4aa-6d6af33b66c5 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.458164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8663f6-c2c1-408f-b4aa-6d6af33b66c5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.458710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8663f6-c2c1-408f-b4aa-6d6af33b66c5 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.460710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 17/39] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:35.467392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8f9ea-8232-4188-8020-d1ab3ceb6456 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.467688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8f9ea-8232-4188-8020-d1ab3ceb6456 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.467974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8f9ea-8232-4188-8020-d1ab3ceb6456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.486410 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-95e8f9ea-8232-4188-8020-d1ab3ceb6456 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:35.487962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-95e8f9ea-8232-4188-8020-d1ab3ceb6456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:35.496410 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 23/40] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:35.519530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8663f6-c2c1-408f-b4aa-6d6af33b66c5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:35.532890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8663f6-c2c1-408f-b4aa-6d6af33b66c5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:35.537765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:35.538437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.538753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.539037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.539808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:35.541463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:35.640073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada644cb-2cad-43f9-9852-514d877aa8a8 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.640424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada644cb-2cad-43f9-9852-514d877aa8a8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.640648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada644cb-2cad-43f9-9852-514d877aa8a8 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.642564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 24/41] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:35.648247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 18/42] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 04:57:35 2021] POST /identity/v3/roles => generated 223 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:35.648674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.648968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.649247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.668798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:35.671230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:35.678540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 25/43] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:35.702600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:35.713817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3d72b-6863-4af3-a6ac-32443aaaa133 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:35.718444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281fd72a-378e-49bd-9e1c-96c60e281b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:35.719303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd72a-378e-49bd-9e1c-96c60e281b69 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.719591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd72a-378e-49bd-9e1c-96c60e281b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.719867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fd72a-378e-49bd-9e1c-96c60e281b69 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.721143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd72a-378e-49bd-9e1c-96c60e281b69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:35.722995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281fd72a-378e-49bd-9e1c-96c60e281b69 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:35.724914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 19/44] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:35.730973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:35.741005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba943066-fc3a-44bb-a03d-fd1082cc93b8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:35.745581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f58673-092a-4258-a477-6e076d67b88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:35.746274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58673-092a-4258-a477-6e076d67b88b admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:35.746561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58673-092a-4258-a477-6e076d67b88b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:35.746870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f58673-092a-4258-a477-6e076d67b88b admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:35.747604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58673-092a-4258-a477-6e076d67b88b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:35.749587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f58673-092a-4258-a477-6e076d67b88b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:35.831849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 26/45] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:57:35 2021] POST /identity/v3/projects => generated 312 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:36.805816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a107-4c5f-4477-a387-34b940cbc6c0 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:36.805816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a107-4c5f-4477-a387-34b940cbc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:36.805816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5a107-4c5f-4477-a387-34b940cbc6c0 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:36.805816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 20/46] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:36.806643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:36.806643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:36.806643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:36.823845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:36.825017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:36.880010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 27/47] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:36.903268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5a107-4c5f-4477-a387-34b940cbc6c0 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:36.915775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5a107-4c5f-4477-a387-34b940cbc6c0 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:36.920005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:36.920794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:36.921082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:36.921359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:36.931931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:36.938780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:36.940007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 21/48] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:36.946150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:36.955001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b494f0c-f179-4bda-b940-a3a6592c90b3 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:36.960123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:36.960774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:36.961057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:36.961334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:36.962075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:36.962380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:36.964021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:36.972072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 28/49] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:36.978405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:36.989569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ef8f4-1329-496d-aa82-69f0f1082705 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:36.994275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:36.995219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:36.995510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:36.995790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:36.997062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:36.998984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:37.000643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 22/50] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:36 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:37.006667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:37.016350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca145c6d-9351-40e3-a6ad-a2af9e4cd494 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:37.021278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f90cc8-d9b8-42fa-845a-1581003f738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:37.022060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f90cc8-d9b8-42fa-845a-1581003f738c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:37.022344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f90cc8-d9b8-42fa-845a-1581003f738c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:37.022650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f90cc8-d9b8-42fa-845a-1581003f738c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:37.023821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f90cc8-d9b8-42fa-845a-1581003f738c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:37.025508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f90cc8-d9b8-42fa-845a-1581003f738c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:37.027288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 29/51] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:37.033055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:37.043162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20a9d7-26c9-4b91-bd89-3fe23c0237e7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:37.047465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:37.048108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:37.048477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:37.048668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:37.049490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.domain.id=default, user.id=ea2c6493cbbf4f86bef2484d6a25608e) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:37.049800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:37.050835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:37.050835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:37.050835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:37.052055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8be7e-5b37-41f3-83ad-4ea97ebf37bb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:37.059104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 23/52] 10.222.0.16 () {56 vars in 1344 bytes} [Tue Aug 10 04:57:37 2021] GET /identity/v3/role_assignments?user.id=ea2c6493cbbf4f86bef2484d6a25608e&scope.domain.id=default&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:37.937053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756faf3e-1fe4-4cba-b977-99eb4904ebe9 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:37.937554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756faf3e-1fe4-4cba-b977-99eb4904ebe9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:37.937554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756faf3e-1fe4-4cba-b977-99eb4904ebe9 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:37.939337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 30/53] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:37.945046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:37.945469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:37.945598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:37.963630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:37.964809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:37.972172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 24/54] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:37.996340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756faf3e-1fe4-4cba-b977-99eb4904ebe9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:38.007933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756faf3e-1fe4-4cba-b977-99eb4904ebe9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:38.012130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c197e2-15a3-46b4-8cc2-d53e01d8a450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:38.012897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c197e2-15a3-46b4-8cc2-d53e01d8a450 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:38.013173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c197e2-15a3-46b4-8cc2-d53e01d8a450 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:38.013441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c197e2-15a3-46b4-8cc2-d53e01d8a450 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:38.014606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c197e2-15a3-46b4-8cc2-d53e01d8a450 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:38.016279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c197e2-15a3-46b4-8cc2-d53e01d8a450 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:38.017809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 31/55] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:37 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:38.023890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:38.032607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe082c75-c0fc-451c-aa6e-611788363700 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:38.037068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:38.037732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:38.038004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:38.038283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:38.039036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:38.040038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:38.040038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:38.040038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:38.041263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7b56d-6cbf-4b1c-8a59-786cad8f288a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:38.162432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 25/56] 10.222.0.16 () {60 vars in 1162 bytes} [Tue Aug 10 04:57:38 2021] POST /identity/v3/projects => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:40.232602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a919d8-1bbb-482b-800f-560ea12c9da6 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:40.233145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a919d8-1bbb-482b-800f-560ea12c9da6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:40.233145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a919d8-1bbb-482b-800f-560ea12c9da6 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:40.235124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 32/57] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:40.240800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:40.241196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:40.241376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:40.259053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:40.260261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:40.315987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 26/58] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:40.342140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a919d8-1bbb-482b-800f-560ea12c9da6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:40.353868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a919d8-1bbb-482b-800f-560ea12c9da6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:40.358042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e828687-b321-4c1f-984c-4e0640efc496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:40.358847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828687-b321-4c1f-984c-4e0640efc496 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:40.359130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828687-b321-4c1f-984c-4e0640efc496 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:40.359403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e828687-b321-4c1f-984c-4e0640efc496 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:40.360699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828687-b321-4c1f-984c-4e0640efc496 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:40.362380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e828687-b321-4c1f-984c-4e0640efc496 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:40.364401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 33/59] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:40 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:40.370027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:40.379495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0652d3-4c28-4233-9e11-50abf25ef338 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:40.383976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:40.384642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:40.384932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:40.385215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:40.385924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:40.386972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:40.386972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:40.386972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:40.388229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e4215-00f7-4f0f-a475-140278da4cf4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:40.475591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 27/60] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:57:40 2021] POST /identity/v3/users => generated 275 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:43.711914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf969-3ceb-4552-ae3b-3d25cbf765bf None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.712418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf969-3ceb-4552-ae3b-3d25cbf765bf None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.712491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1babf969-3ceb-4552-ae3b-3d25cbf765bf None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.714291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 34/61] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:43.728600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a463e6-7e0e-4a65-bdf3-aed936453634 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.729103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a463e6-7e0e-4a65-bdf3-aed936453634 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.729318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a463e6-7e0e-4a65-bdf3-aed936453634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.751267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c0a463e6-7e0e-4a65-bdf3-aed936453634 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:43.752546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c0a463e6-7e0e-4a65-bdf3-aed936453634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:43.765009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 28/62] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:43.802110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf969-3ceb-4552-ae3b-3d25cbf765bf None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:43.817077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1babf969-3ceb-4552-ae3b-3d25cbf765bf None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:43.824103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:43.824920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.825359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.825641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.829894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53070612-4a73-4bb7-a09d-624574c71da5 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.830185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53070612-4a73-4bb7-a09d-624574c71da5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.830461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53070612-4a73-4bb7-a09d-624574c71da5 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.832848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 29/63] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:43.838980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.839508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.840004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.842277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:43.849941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:43.851493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 35/64] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:43 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:43.857298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:43.867151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:43.868583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:43.878198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd72919b-6555-4014-a5cd-e18c5f95c63b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:43.884362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 30/65] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:43.892579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:43.893482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.893953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.894426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.895890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:43.896391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:43.898183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:43.906820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:43.916925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f902d2-69b2-43a7-95d6-86cabed22063 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:43.918979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 36/66] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:43 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:43.925123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:43.932210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:43.933212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.933674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.934114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.935658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeee9a8-1729-4bd3-8714-0f6a4c9e7ba6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:43.948567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:43.949343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:43.950399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:43.956023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:43.956536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:43.960357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:43.969806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 31/67] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:57:43.976643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:43.985529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:43.988059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:43.992640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42c1e7-634a-4c74-8366-a3760a05f85f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:43.994769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 37/68] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:43 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:43.999843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.000890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.006794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.007239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.007688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.010154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.011766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.012932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:44.012932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:44.012932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:44.015507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb7eb-767f-431c-b3bd-391d8a0a04cf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.016583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaaa34a-5819-4015-b680-0bfaa37774e7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.032992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564649a-775a-41de-8cef-0230dc9b0c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.033542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 32/69] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.034171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564649a-775a-41de-8cef-0230dc9b0c72 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.034683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564649a-775a-41de-8cef-0230dc9b0c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.035155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564649a-775a-41de-8cef-0230dc9b0c72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.035255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38589bd-1fdd-4678-b626-bd014fb77424 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.036178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38589bd-1fdd-4678-b626-bd014fb77424 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.036535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38589bd-1fdd-4678-b626-bd014fb77424 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.042913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 33/70] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:44.043560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38589bd-1fdd-4678-b626-bd014fb77424 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.045560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564649a-775a-41de-8cef-0230dc9b0c72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.047915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564649a-775a-41de-8cef-0230dc9b0c72 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.057202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38589bd-1fdd-4678-b626-bd014fb77424 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.060345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 38/71] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:44.062037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.062548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.063059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.068180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.069097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.069384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.069660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.071074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.073019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.075154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 34/72] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.076186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.086222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:44.087494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:44.088187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463ee8a-8dc0-42d6-8761-e9a698e78f9b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.093178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.094572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.095064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.095525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.096158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 39/73] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:44.097214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.103503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.105784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.107112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6ef0a-0ad8-47a8-a15a-a6653896a68a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.108293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 35/74] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.114626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.122747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.123604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.124031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.124448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.125729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36886fa6-3270-4b2f-a7d6-7233faeea36f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.130887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.131740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.132215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.132911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.133752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] RBAC: Adding query filter params (role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1, user.id=f099659e0c6745fd8be02a3dac109bc2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.134067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.134405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.135983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e5b9e-5bc4-442c-b2c1-de7e9dc1ea4f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.136219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.146206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 36/75] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/role_assignments?user.id=f099659e0c6745fd8be02a3dac109bc2&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:44.146206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0ba7-4c32-4338-888e-edcfa364e3cd None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.146206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0ba7-4c32-4338-888e-edcfa364e3cd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.146206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa0ba7-4c32-4338-888e-edcfa364e3cd None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.146540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 40/76] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:44.146907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.150760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 37/77] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:44 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:44.152281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.152758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.153220 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.157311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd1a38-9701-437e-906c-830e960f98fb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.162262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.163129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.163417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.163698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.173739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:44.175308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:44.175924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:44.183428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:44.183951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 38/78] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:44.190896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:44.190896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.191201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.209052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04fdca-00b3-4079-99c8-8548e3e316ef admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.213455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c52f8c-6044-4a3d-b870-b8a1f4ab72cd None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.223508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.223508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.223508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.223508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.223841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.223932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.224000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.224000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.224000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.224000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.224000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.224269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.224332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.224808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 42/80] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.225866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.233466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 39/81] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.234506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.236889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e02528-e8ce-4a92-95f7-8ad49e9148a9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.243710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.244530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.244813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.245092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.249308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db323e87-1046-4d6d-a09c-97fea2b116ce admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.254486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.255556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.256043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.256523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.257566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1, user.id=ea2c6493cbbf4f86bef2484d6a25608e) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.258083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.258613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:44.260478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.266800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:44.267227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 40/82] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/role_assignments?user.id=ea2c6493cbbf4f86bef2484d6a25608e&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.268324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.268447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 43/83] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:44.279674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.286983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b7518-a17f-4635-9a0e-a7321a9ac56b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.292610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e76c5-f169-4775-8072-19c8d5fb6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.293330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe76209-de39-4e97-8a43-9f50ac633db0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.294157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e76c5-f169-4775-8072-19c8d5fb6230 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.294706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e76c5-f169-4775-8072-19c8d5fb6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.295186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e76c5-f169-4775-8072-19c8d5fb6230 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.297128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e76c5-f169-4775-8072-19c8d5fb6230 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.298494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.299232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.299520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.299795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.300573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.300991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.301889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e76c5-f169-4775-8072-19c8d5fb6230 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.303284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea025d1-80ee-4d4e-b29f-ad37361fdd51 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.308948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 41/84] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.308948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cdf12-500c-43da-afe2-f254d040fa35 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.308948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cdf12-500c-43da-afe2-f254d040fa35 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.308948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cdf12-500c-43da-afe2-f254d040fa35 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.308948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 42/85] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:44.310560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cdf12-500c-43da-afe2-f254d040fa35 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.313983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 44/86] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.315796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.316096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.316380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.325316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cdf12-500c-43da-afe2-f254d040fa35 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.330442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.331504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.332020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.332542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.337780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:44.339417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:44.343334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.345931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.349569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 45/87] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:44.350440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.358982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 43/88] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:44.360541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667ed37-375c-43f5-90a3-be9770a2af98 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.365985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.369804 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.371056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.371542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.371964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.373485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.376013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.376468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f710c-6aba-4b9e-a38b-91428da2378e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.378143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 46/89] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.379344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.387180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.388587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.389067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.389550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.391119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7a4c8-6b08-4b26-9adf-ab8179368585 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.391866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.395938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.396620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.397630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.398070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.398529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.398926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 44/90] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:44.399540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.400662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.402642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.404595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.406048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.416325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b9237-d8da-4f9e-b2ce-fb42348909f2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.417089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa75bd6-fa69-4d84-b1cf-098057363ef6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.421024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.421719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.421979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.422262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.423449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.424299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.424727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.425145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.426716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] RBAC: Adding query filter params (role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1, user.id=f099659e0c6745fd8be02a3dac109bc2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.427218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.429329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.432420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.435333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.436046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 48/92] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/role_assignments?user.id=f099659e0c6745fd8be02a3dac109bc2&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:44.442727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.453535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360865d-554d-48c5-9c1b-f17ef967b72d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.456569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 45/93] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:44.459733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bcb11-2ea2-4111-95f4-21c50db94090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.460599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bcb11-2ea2-4111-95f4-21c50db94090 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.461032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bcb11-2ea2-4111-95f4-21c50db94090 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.461481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bcb11-2ea2-4111-95f4-21c50db94090 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.462391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bcb11-2ea2-4111-95f4-21c50db94090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.464119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.464764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bcb11-2ea2-4111-95f4-21c50db94090 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.482911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f1e74-7d8c-4b39-b013-fd203ca925d2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.489298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.490459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.492715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.492715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] PATH_INFO: `/v3/projects/302284a16ed54a56a67750fe4d350fba` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.493600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] RBAC: Authorizing `identity:get_project(project_id=302284a16ed54a56a67750fe4d350fba)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.495882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.498038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/projects/302284a16ed54a56a67750fe4d350fba => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:44.504661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:44.515202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57d7db-16db-42c8-b3b0-929b91e49877 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:44.524298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:44.525068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:44.525434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:44.525787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:44.532001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] RBAC: Adding query filter params (role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=302284a16ed54a56a67750fe4d350fba, user.id=f099659e0c6745fd8be02a3dac109bc2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:44.532503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:44.534760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc27aa-8d84-495e-a4ef-7282a418b8da admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:44.542138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 47/95] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:44 2021] GET /identity/v3/role_assignments?user.id=f099659e0c6745fd8be02a3dac109bc2&scope.project.id=302284a16ed54a56a67750fe4d350fba&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:44.575236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 49/96] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:57:44 2021] POST /identity/v3/projects => generated 302 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:46.747700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f227-2792-4cd4-8d06-f2ad5729a0bf None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.748197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f227-2792-4cd4-8d06-f2ad5729a0bf None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.748301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f227-2792-4cd4-8d06-f2ad5729a0bf None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.750262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 48/97] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:46.756943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.757360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.757528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.798244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:46.799531 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:46.838769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7547c50-9c6a-4dfd-be97-1370160c6025 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.839087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7547c50-9c6a-4dfd-be97-1370160c6025 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.839342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7547c50-9c6a-4dfd-be97-1370160c6025 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.841830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 49/98] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:46.848813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d8aba-259f-48bd-89cb-578cd0b68bdc None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.849234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d8aba-259f-48bd-89cb-578cd0b68bdc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.849639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d8aba-259f-48bd-89cb-578cd0b68bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.888395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7d9d8aba-259f-48bd-89cb-578cd0b68bdc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:46.889621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7d9d8aba-259f-48bd-89cb-578cd0b68bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:46.893180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 50/99] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:46.906069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:46.916611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:46.924653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b89e-c87d-4bb9-aca2-681d72979d7c None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.925229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b89e-c87d-4bb9-aca2-681d72979d7c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.925515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469b89e-c87d-4bb9-aca2-681d72979d7c None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.927782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ab0c7-0e60-4659-947d-7b7c59724d82 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:46.928120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 51/101] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:46.929817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b89e-c87d-4bb9-aca2-681d72979d7c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:46.935513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0847ff5-1b64-4ea7-83b4-30482e0ec4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:46.936319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847ff5-1b64-4ea7-83b4-30482e0ec4bd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.936605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847ff5-1b64-4ea7-83b4-30482e0ec4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.936883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0847ff5-1b64-4ea7-83b4-30482e0ec4bd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.948462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0847ff5-1b64-4ea7-83b4-30482e0ec4bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:46.949081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469b89e-c87d-4bb9-aca2-681d72979d7c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:46.953715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:46.954762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.955242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.955485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-b0847ff5-1b64-4ea7-83b4-30482e0ec4bd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:46.955934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.956754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 51/102] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:46 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:46.957988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:46.958279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:46.958947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:46.969677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:46.976351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:46.977535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:46.978119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:46.980022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 52/103] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:46.981160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:46.990148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:46.990148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:46.998491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24387b-d999-48fa-ac12-699ed4154e8d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.002924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.003571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.003857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.004834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.005581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:47.005891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.007541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.008482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7d9b-7441-492f-bf1b-f0fa74172012 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.018324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 53/105] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.019053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.019448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.020366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.020883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.021362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.022310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] RBAC: Adding query filter params (name=member) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:47.022839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.025708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.028755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbda95-b1bb-46e3-a6c4-c7610c5fc31a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.032935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.033721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.034007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.034285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.036628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 53/106] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:46 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.037940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.048704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:47.052326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293bbf45-ade7-49e7-8339-28e95139751d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.056769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:47.056951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.057780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.058246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 54/107] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:47.058349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.058349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.058781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.059575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.061410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.063200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 54/108] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.069315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.069600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2239f2-a22e-4e9f-81eb-4b168f3a54e9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.074116 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.075001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.075289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.075569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.076748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.078912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.079021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5ece5-763f-4385-85c2-54553316d440 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.081398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 55/109] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.082185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.089012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.089690 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.089970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.090246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.091035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:47.091348 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.092405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a36d2-0c0a-47f8-9c72-51c8b1196e16 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.092956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.096951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.098421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.098797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.099148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.100385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.102551 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 55/110] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.102677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.103226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.104524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 56/111] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.112626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.118728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afae9a-dab4-4541-a969-b3e44dc95e5a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.124195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.125054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.125337 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.125615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.126370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d77fc-f0e8-4550-bd18-e81466e9a6c8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.126855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.128940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.130700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 56/112] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.136211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.137540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.139473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.140069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.140525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.142201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.142925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f559c27-1d11-4fab-971e-69ad66ac95e3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.144801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.147296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 57/113] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:47.148323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.151331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.152314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.152669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.153017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/users/ea2c6493cbbf4f86bef2484d6a25608e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.155942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0498e0a8099f45c7870d1f5f8ad93fd1, user_id=ea2c6493cbbf4f86bef2484d6a25608e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.158816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.164293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674674-77fd-4ef4-908b-42a795f90938 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.168872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.169876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.170331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.170743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/users/f099659e0c6745fd8be02a3dac109bc2/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.172919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0498e0a8099f45c7870d1f5f8ad93fd1, user_id=f099659e0c6745fd8be02a3dac109bc2, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.174189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:47.174189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:47.174189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:47.176949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d014b1e-161c-4605-b353-ced0f56fc7fa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.304625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 57/114] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:47 2021] PUT /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/users/ea2c6493cbbf4f86bef2484d6a25608e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:57:47.305746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.319321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 58/115] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:47 2021] PUT /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/users/f099659e0c6745fd8be02a3dac109bc2/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:57:47.321211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ec0e-962f-4182-a4e0-d8a8ea8374de None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.321766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ec0e-962f-4182-a4e0-d8a8ea8374de None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.322248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99ec0e-962f-4182-a4e0-d8a8ea8374de None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.324566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 59/116] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:47.332234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.333684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.334176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.355320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:47.356978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:47.461464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 60/117] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:47.489361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728705fe-7be2-4937-971c-697c6ed72703 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.495724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.499352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.500448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.500580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.500818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] PATH_INFO: `/v3/projects/302284a16ed54a56a67750fe4d350fba` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.503515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] RBAC: Authorizing `identity:get_project(project_id=302284a16ed54a56a67750fe4d350fba)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.506298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.508533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 58/118] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/projects/302284a16ed54a56a67750fe4d350fba => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.509393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed082-9e52-4712-b750-284fd0aca933 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.515406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.517873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.519119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.519611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.520141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.531081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9fcca-c840-480c-980d-9ad07b516175 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.538614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:47.543128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:47.543814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.544777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.545011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 61/119] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:57:47.545116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.545402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] PATH_INFO: `/v3/projects/302284a16ed54a56a67750fe4d350fba/users/f099659e0c6745fd8be02a3dac109bc2/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.552018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302284a16ed54a56a67750fe4d350fba, user_id=f099659e0c6745fd8be02a3dac109bc2, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.553427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.555679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.568276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925e98a-dfc2-438d-b800-2104b1274151 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.573858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.574603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.574952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.575238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.576041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:47.579399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.579399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a7518b-22f5-401e-93c1-bc01f58a1b89 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.588305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 62/120] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:47.589637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3a01b-c4e2-421b-8e0b-ecbabe1a979b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.589931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3a01b-c4e2-421b-8e0b-ecbabe1a979b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.590208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3a01b-c4e2-421b-8e0b-ecbabe1a979b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.595944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 63/121] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:47 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:47.596680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3a01b-c4e2-421b-8e0b-ecbabe1a979b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.609027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3a01b-c4e2-421b-8e0b-ecbabe1a979b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.614134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0486a40-83f1-4118-b25c-46da6d6ff769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.615108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486a40-83f1-4118-b25c-46da6d6ff769 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.615509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486a40-83f1-4118-b25c-46da6d6ff769 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.615715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0486a40-83f1-4118-b25c-46da6d6ff769 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.616926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0486a40-83f1-4118-b25c-46da6d6ff769 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.619185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0486a40-83f1-4118-b25c-46da6d6ff769 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.620953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.621945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.622231 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.622506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.640782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:47.641959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:47.652917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 59/123] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:47 2021] PUT /identity/v3/projects/302284a16ed54a56a67750fe4d350fba/users/f099659e0c6745fd8be02a3dac109bc2/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 04:57:47.653744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.658194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 65/124] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:47.684728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.699857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593fd0b-601e-445c-9ff8-42af1138775f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.727776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff711a-b0d0-4b37-8a19-a5e66e6a5e01 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.733130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.734235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.734594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.734928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.736722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.739728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.742829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.748643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.761684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0393ce5-81dc-4944-ad3f-13ac795aad46 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.767696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db3de5-1bde-490d-b6f8-4bba765c185f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.768661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3de5-1bde-490d-b6f8-4bba765c185f admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.769005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3de5-1bde-490d-b6f8-4bba765c185f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.769287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db3de5-1bde-490d-b6f8-4bba765c185f admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/users/f099659e0c6745fd8be02a3dac109bc2/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.772934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db3de5-1bde-490d-b6f8-4bba765c185f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0498e0a8099f45c7870d1f5f8ad93fd1, user_id=f099659e0c6745fd8be02a3dac109bc2, role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.775892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db3de5-1bde-490d-b6f8-4bba765c185f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.800420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.801819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.802156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.802484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.803796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.805623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.807534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:47.813973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:47.825721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1f1839-2c9d-49f9-a8ee-448c3d1c8f0c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:47.830554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:47.831386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:47.831677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:47.832016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:47.832965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:47.834330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:47.834330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:47.834330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:47.835738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb9dc9-da56-43b7-a135-2d304222e7a1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:47.851854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 61/127] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:47 2021] PUT /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/users/f099659e0c6745fd8be02a3dac109bc2/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 04:57:47.957220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 67/128] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:57:47 2021] POST /identity/v3/users => generated 283 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:57:49.841577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad110-11f1-4db3-aebc-ea3568ad3eb6 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:49.842057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad110-11f1-4db3-aebc-ea3568ad3eb6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:49.842057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ad110-11f1-4db3-aebc-ea3568ad3eb6 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:49.843881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 62/129] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:49.856946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:49.857534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:49.857534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:49.879675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:49.880894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:49.955276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 68/130] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:50.000080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ad110-11f1-4db3-aebc-ea3568ad3eb6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.016632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ad110-11f1-4db3-aebc-ea3568ad3eb6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.021165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.022002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.022288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.022567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.040733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:50.047749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:50.049006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 63/131] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:49 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:50.056397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.065944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb24b1-1f29-4da1-b442-626c8e667754 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.070511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.071219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.071510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.071793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.072561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:50.072875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.074536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.083929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 69/132] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.090101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.101776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8055f0-3ca5-4a78-8605-30c831f2531c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.106201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c5bbda-ce02-4643-8b1e-3ca46b1cb150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.107090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5bbda-ce02-4643-8b1e-3ca46b1cb150 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.107376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5bbda-ce02-4643-8b1e-3ca46b1cb150 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.107660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5bbda-ce02-4643-8b1e-3ca46b1cb150 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.108848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5bbda-ce02-4643-8b1e-3ca46b1cb150 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.111039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c5bbda-ce02-4643-8b1e-3ca46b1cb150 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.112827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 64/133] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.118835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.128714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9cead-a2eb-4b84-9478-2c180c4e8729 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.133727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.134392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.134706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.134985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.143293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.145192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.151207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef1f-3e81-4492-b799-f11f7e01ac48 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.151496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef1f-3e81-4492-b799-f11f7e01ac48 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.151778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b2ef1f-3e81-4492-b799-f11f7e01ac48 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.153699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 65/134] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:50.159370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.159659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.159942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.169712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 70/135] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:50.177486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.189662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd4f26-e6cd-4e02-a77e-142ff9538d82 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.190315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:50.191302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:50.200180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.201308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 66/136] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:50.201581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.202085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.202565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.207363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.209871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.211869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 71/137] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.218384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.231903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5f824-e8da-4ff5-bf0e-cdf7ee617f35 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.234731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.236991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.237842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.238274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.239255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.243739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] RBAC: Adding query filter params (role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1, user.id=f099659e0c6745fd8be02a3dac109bc2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:50.243739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.243739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.252452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918b349-e514-45b7-bdb0-70e2c44c1c3e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.255287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 67/138] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/role_assignments?user.id=f099659e0c6745fd8be02a3dac109bc2&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.261119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.262094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.262482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.262906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.280223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:50.287927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:50.289542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 72/139] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:50.296811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.314474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00244f3a-f321-4a25-9fb7-ad551800be4e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.319498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.320388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.320824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.321286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.322227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:50.322718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.324484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.338965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.345397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.361465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a85567-7f0d-42e3-a616-ac3a59baeb8c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.372167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.373066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.373352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.373631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.375507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.377490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.379295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 73/141] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.385630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.400120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766182d1-2491-4283-ae6f-518451d52dff admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.404946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.405836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.406269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.406716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.422826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.424946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.440781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 69/142] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:50.447596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.463326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d3d26-16ae-4b03-a64f-d8e3f5bb1c88 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.471262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00bc976-675b-4ad3-9d81-389e72a605d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.472221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bc976-675b-4ad3-9d81-389e72a605d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.472566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bc976-675b-4ad3-9d81-389e72a605d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.473395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00bc976-675b-4ad3-9d81-389e72a605d0 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.475728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bc976-675b-4ad3-9d81-389e72a605d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.477921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00bc976-675b-4ad3-9d81-389e72a605d0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.480332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 74/143] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.488190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.504230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a675e3-302c-4105-b9ed-938455882a45 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.509234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.510224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.510741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.511235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.512283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1, user.id=ea2c6493cbbf4f86bef2484d6a25608e) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:50.512819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.514965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23995b38-71f8-414e-b009-a858b69809d8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.537520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 70/144] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/role_assignments?user.id=ea2c6493cbbf4f86bef2484d6a25608e&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.563221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5652-48a0-435a-8779-03b65a9aae67 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.563569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5652-48a0-435a-8779-03b65a9aae67 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.563859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5652-48a0-435a-8779-03b65a9aae67 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.565915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 75/145] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:50.573039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.573705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.574191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.594136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a94f-e65f-4174-9e2d-989963631c59 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.594471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a94f-e65f-4174-9e2d-989963631c59 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.594744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a94f-e65f-4174-9e2d-989963631c59 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.596684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 76/146] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:50.598978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:50.600447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:50.612994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 71/147] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:50.614786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.615080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.615357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.642139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:50.643468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:50.655490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 77/148] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:50.656716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.672024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bdaff-4203-43e7-bc71-85c0656ee0e8 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.677204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.678394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.678904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.679385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.703408 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:50.715318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:50.716756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 72/149] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:50.718180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.725113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.729028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cb815-c9dc-4f29-9904-9ea0ccb2b1bf None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.737220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.738050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.738377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.738646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d1fd-a9e5-42db-b8df-550eaffd88dd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.738819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.751950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.752638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.752920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.753503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.753957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:50.754297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.755931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.759560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:50.766851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:50.768269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 78/150] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:50.774020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:50.776275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.780865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.795832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e88b9-a2da-4fbe-baee-edfd0738f8f8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.801002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402503-fe14-4ea5-bfd3-6075d6f85792 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.812812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.813706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.813996 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.814272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.815253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.815939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.816226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.816504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.817785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:50.818091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.819318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.819739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.821480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.823457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 74/152] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.829912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.838080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 79/153] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:50.844296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.847665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75989e91-e718-4838-9961-030d0fa2d800 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.864947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.865545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.865831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.866113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.870498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cb32-dbd8-4dbf-bc1b-07aa5ff54915 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.880052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.881586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.881894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.882208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.883768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.884409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.886077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.886261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.892574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 80/154] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:50.899690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.905938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 75/155] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:57:50.913744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.915963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee6bc0-fb21-4102-8b42-4bb26065279f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.925032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.925773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.926090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.926361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.929116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f1a9a-8c84-4d5b-a1e1-d41e3a7cf7c1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.939948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.942848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.947936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.948820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.949105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.949379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] PATH_INFO: `/v3/projects/302284a16ed54a56a67750fe4d350fba` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.955421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] RBAC: Authorizing `identity:get_project(project_id=302284a16ed54a56a67750fe4d350fba)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.956726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 81/156] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:50.957591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.959712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 76/157] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/projects/302284a16ed54a56a67750fe4d350fba => generated 312 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:50.963888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.966463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:50.975387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b8587-2252-4cdb-b363-d9d6e7ba653f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.984244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05d3b6-b4b8-47f4-8d62-1b7ac7b30687 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:50.986721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:50.987587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:50.987862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:50.988136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:50.991288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:50.993360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:50.995261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 82/158] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:51.001222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:51.001899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:51.002184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:51.002461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:51.003339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] RBAC: Adding query filter params (role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=302284a16ed54a56a67750fe4d350fba, user.id=f099659e0c6745fd8be02a3dac109bc2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:51.003650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:51.005563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e83f0-9073-4245-8e56-cea5ed3f9e24 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:51.012212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 77/159] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:50 2021] GET /identity/v3/role_assignments?user.id=f099659e0c6745fd8be02a3dac109bc2&scope.project.id=302284a16ed54a56a67750fe4d350fba&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:51.016747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:51.032077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67711c-5b83-485e-86f7-e58fd89c7fd5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:51.041076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:51.041752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:51.042029 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:51.042298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:51.043190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] RBAC: Adding query filter params (role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1, user.id=f099659e0c6745fd8be02a3dac109bc2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:51.043496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:51.045378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba925-db7a-4b60-9497-4fcb75a557c1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:51.055394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 83/160] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:51 2021] GET /identity/v3/role_assignments?user.id=f099659e0c6745fd8be02a3dac109bc2&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:51.975472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9b6c6-ec88-4941-b020-f4e790fa54b4 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:51.976146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9b6c6-ec88-4941-b020-f4e790fa54b4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:51.976146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9b6c6-ec88-4941-b020-f4e790fa54b4 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:51.977705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 78/161] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:51.983965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:51.984434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:51.984599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.002510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:52.003727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:52.011880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 84/162] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:52.037030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9b6c6-ec88-4941-b020-f4e790fa54b4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.049391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9b6c6-ec88-4941-b020-f4e790fa54b4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.054268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.055094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.055372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.055643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.066483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:52.074072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:52.075375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 79/163] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:52.082465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.092040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2f00c-33ca-47e2-94ae-a9306fc7d932 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.096523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.097187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.097466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.097737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.098512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:52.098844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.100438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.109390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 85/164] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:52.115935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.126450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9ec4b-cbe3-4cc4-8ade-14415d0f1ff7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.131579 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3042c-0cb6-4fcf-a666-be47179e30f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.132463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3042c-0cb6-4fcf-a666-be47179e30f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.132744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3042c-0cb6-4fcf-a666-be47179e30f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.133015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3042c-0cb6-4fcf-a666-be47179e30f0 admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.150640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3042c-0cb6-4fcf-a666-be47179e30f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.152902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3042c-0cb6-4fcf-a666-be47179e30f0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.154932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 80/165] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:52.161381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.171490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0886f66-0820-4551-91da-b1360035fbc1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.176467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.177118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.177396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.177666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.186154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.187971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.202107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 86/166] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:52.204008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d5b3-52d1-47a0-b008-40891b851767 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.204302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d5b3-52d1-47a0-b008-40891b851767 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.204468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.204615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d999d5b3-52d1-47a0-b008-40891b851767 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.206704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 81/167] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:52.214208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.214494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.214832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.215846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c5f9de-2c4e-4441-8bbb-49862e8c1afe admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.220401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.221454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.221737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.222914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.224089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.226243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.228298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 87/168] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:52.234546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.235116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:52.236299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:52.244344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a411cd-6402-4988-8570-d3fb886e20f3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.244846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 82/169] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:52.249407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.250128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.250412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.250722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.251686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] RBAC: Adding query filter params (role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=bd1cb09c40f542528bcf1e352639c35a, user.id=9c21df549a3c46648a2d1e3963e9091b) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:52.251991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.253954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.259764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 88/170] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/role_assignments?user.id=9c21df549a3c46648a2d1e3963e9091b&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:52.269316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.279836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ba95d-9d91-417b-afd7-84d4a35a9d0a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.284525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.285939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.286222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.286494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.298939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:52.305938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:52.307216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 83/171] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:52.313819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.324603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d842cc-f268-433e-bcac-c3cec681c719 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.329240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.329916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.330196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.330464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.331435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:52.331737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.334245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.344140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 89/172] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:52.350333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.361005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24101d7a-352e-41ba-bd56-d3359607dd2c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.365809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.366795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.367075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.367404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.368711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.370612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.372447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 84/173] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:52.378652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.389282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac5dba-9f6d-4bdb-8974-52f50757fbbd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.393772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.394438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.395430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.395708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.404826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.406735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.416977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 90/174] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:52.423176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.433970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82ca2f-4df7-4e7f-9d81-8b86349028f4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.438524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b382b0-0a80-4ba5-bd2d-360931a6224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.439398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b382b0-0a80-4ba5-bd2d-360931a6224c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.439676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b382b0-0a80-4ba5-bd2d-360931a6224c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.439948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b382b0-0a80-4ba5-bd2d-360931a6224c admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.441117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b382b0-0a80-4ba5-bd2d-360931a6224c admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.443748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b382b0-0a80-4ba5-bd2d-360931a6224c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.445411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 85/175] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:52.451833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:52.461305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e7361-e0aa-4d72-9c60-b84249e8290f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:52.465877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:52.466569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:52.466877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:52.467149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:52.468073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=bd1cb09c40f542528bcf1e352639c35a, user.id=ea2c6493cbbf4f86bef2484d6a25608e) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:52.468378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:52.470293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86562951-0c0a-4192-9bf7-20df8c332b97 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:52.477041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 91/176] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:52 2021] GET /identity/v3/role_assignments?user.id=ea2c6493cbbf4f86bef2484d6a25608e&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:53.003107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f483106-ca56-4478-9f55-88cb2f5e0e8e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.004211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f483106-ca56-4478-9f55-88cb2f5e0e8e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.004706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f483106-ca56-4478-9f55-88cb2f5e0e8e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.006763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 86/177] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:53.012643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7704-1f38-439b-bcaf-377293c95394 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.013062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7704-1f38-439b-bcaf-377293c95394 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.013234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f7704-1f38-439b-bcaf-377293c95394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.031682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bd6f7704-1f38-439b-bcaf-377293c95394 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:53.033488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bd6f7704-1f38-439b-bcaf-377293c95394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:53.042299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 92/178] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:53.067427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f483106-ca56-4478-9f55-88cb2f5e0e8e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.079500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f483106-ca56-4478-9f55-88cb2f5e0e8e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.084611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.085407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.085685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.085951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.096138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:53.099450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f044-2137-4dad-906b-818e990b5b7f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.099948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f044-2137-4dad-906b-818e990b5b7f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.100430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8f044-2137-4dad-906b-818e990b5b7f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.102383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 93/179] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:53.104177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:53.105370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 87/180] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:53.108692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.109188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.109657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.112177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.122526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75540c-7a4e-45e7-936e-0c4130894a57 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.127098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.127753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.128033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.128306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.129135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:53.129441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.131131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.131513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:53.132982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:53.140704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 88/181] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:53.141398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 94/182] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:53.147397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.159929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c80200-41c7-4aaa-85fe-82238ad1931b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.164927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.165862 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.166143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.166418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.167762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.169247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.172372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.174304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 89/183] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:53.179378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e5b3-7cd3-41fd-9aec-77fc679e5254 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.181534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.184226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.185024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.185305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.185579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.186774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.188481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.190218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 95/184] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:53.193768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1be65-164e-4b53-81e4-3e9ef6012081 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.196705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.199098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.199974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.200478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.200947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.206699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5465da3-db22-4d81-98db-5367ba4b719a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.210558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.211478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.212122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.212405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.212731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] PATH_INFO: `/v3/groups` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.213475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.213734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.214571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:53.214571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:53.214571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:53.215799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151e9dd-cb81-49b8-bb0d-51c79692001e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.224214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 90/185] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:57:53.230347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.239802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f57ef8-9757-471b-b1df-d2c3411c646d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.244345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.245357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.245868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.246368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.247734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.249944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.251792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 91/186] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:53.258176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:53.268024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c2777-ffb2-4569-919b-922e40bca37e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:53.272568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:53.277274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:53.277274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:53.277274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:53.277274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] RBAC: Adding query filter params (role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=bd1cb09c40f542528bcf1e352639c35a, user.id=9c21df549a3c46648a2d1e3963e9091b) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:53.277274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:53.277674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afd36b-2177-4735-a3a9-b62a87cf6a73 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:53.283189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 92/187] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:53 2021] GET /identity/v3/role_assignments?user.id=9c21df549a3c46648a2d1e3963e9091b&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:53.304849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 96/188] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Aug 10 04:57:53 2021] POST /identity/v3/groups => generated 229 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:57:54.553083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b53155-17f0-4f49-ba03-594c126354ae None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.553580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b53155-17f0-4f49-ba03-594c126354ae None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.553685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b53155-17f0-4f49-ba03-594c126354ae None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.555433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 93/189] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:54.561492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.561924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.562102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.582528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:54.584919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:54.596416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 97/190] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:54.622514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b53155-17f0-4f49-ba03-594c126354ae None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:54.641621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b53155-17f0-4f49-ba03-594c126354ae None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:54.647003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:54.648038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.648514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.648979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.660073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:54.667709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:54.669105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 94/191] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:54.675664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:54.685534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27c630b-b6c3-4935-ad5f-07f607a15da0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:54.690126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:54.690836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.691122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.691397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.692188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:54.692492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:54.694106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:54.703160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 98/192] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:54.709580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:54.720456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eedf3d-b5e8-4084-9b52-0eeb9a681ef8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:54.725485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:54.726334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.726647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.726927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.728123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:54.730264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:54.732067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 95/193] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:54 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:54.738084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:54.748135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b298eb74-2613-47d7-8b84-319f1e9100f4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:54.752723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa40f28-3cb7-4e9f-b71b-cb85db4fb0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:54.753613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40f28-3cb7-4e9f-b71b-cb85db4fb0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.753929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40f28-3cb7-4e9f-b71b-cb85db4fb0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.754733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa40f28-3cb7-4e9f-b71b-cb85db4fb0f3 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.755959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa40f28-3cb7-4e9f-b71b-cb85db4fb0f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:54.758078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa40f28-3cb7-4e9f-b71b-cb85db4fb0f3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:54.760321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 99/194] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:54 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:54.766799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:54.778459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37fbc6-5136-435c-963b-3e6b01335010 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:54.783580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:54.784815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.785344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.785824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a/users/9c21df549a3c46648a2d1e3963e9091b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.788264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1cb09c40f542528bcf1e352639c35a, user_id=9c21df549a3c46648a2d1e3963e9091b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:54.791238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:54.822090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe3e34-e008-4a16-9361-2eba942897fd None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.822369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe3e34-e008-4a16-9361-2eba942897fd None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.822696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe3e34-e008-4a16-9361-2eba942897fd None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.824600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 100/195] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:54.830395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.830685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.830965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.849509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:54.850708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:54.862498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 96/196] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:54 2021] PUT /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a/users/9c21df549a3c46648a2d1e3963e9091b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:57:54.871893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 101/197] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:54.897975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:54.970473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca317c9-ad6d-4e11-bc0e-4e2fe7f6bd6f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:54.975165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:54.975982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:54.976268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:54.976543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:54.987793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:54.995357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:54.996944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 97/198] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:55.003573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.014264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7de3765-76ef-4c97-8e31-0ef7f5a56142 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.019481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.020619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.021168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.021642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.022694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:55.023150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.025157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.035295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 102/199] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:55.041655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.054459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db816d1-e2a9-4db4-9067-bd3adebd1096 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.059168 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.060123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.060402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.060726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.062527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.064438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.066185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 98/200] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:55.072303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.083055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4763c6-d6dc-4d15-907d-ba3df124faf1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.088100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8bbfaa-71b9-4069-8e35-a334ca7ae35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.089081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bbfaa-71b9-4069-8e35-a334ca7ae35a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.089413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bbfaa-71b9-4069-8e35-a334ca7ae35a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.089689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8bbfaa-71b9-4069-8e35-a334ca7ae35a admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.090957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bbfaa-71b9-4069-8e35-a334ca7ae35a admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.093083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8bbfaa-71b9-4069-8e35-a334ca7ae35a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.095335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 103/201] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:55.101678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.111896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d568765-2b06-4918-aa29-f7f704f62d00 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.116530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4da21e-f51b-42e4-b2db-160b66b5cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.117422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da21e-f51b-42e4-b2db-160b66b5cf83 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.117759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da21e-f51b-42e4-b2db-160b66b5cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.118037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da21e-f51b-42e4-b2db-160b66b5cf83 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a/users/ea2c6493cbbf4f86bef2484d6a25608e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.120156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da21e-f51b-42e4-b2db-160b66b5cf83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1cb09c40f542528bcf1e352639c35a, user_id=ea2c6493cbbf4f86bef2484d6a25608e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.122962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da21e-f51b-42e4-b2db-160b66b5cf83 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.194971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 99/202] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:55 2021] PUT /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a/users/ea2c6493cbbf4f86bef2484d6a25608e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:57:55.478490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8cec-061f-4a5f-8d1c-3979d9f03e7a None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.478853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8cec-061f-4a5f-8d1c-3979d9f03e7a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.479032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb8cec-061f-4a5f-8d1c-3979d9f03e7a None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.480933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 104/203] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:55.487224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121ffb8-96cc-4041-a0bb-ee0e09a80fd9 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.487516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121ffb8-96cc-4041-a0bb-ee0e09a80fd9 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.487797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121ffb8-96cc-4041-a0bb-ee0e09a80fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.506125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5121ffb8-96cc-4041-a0bb-ee0e09a80fd9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:55.507481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5121ffb8-96cc-4041-a0bb-ee0e09a80fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:55.578044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 100/204] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:55.603189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8cec-061f-4a5f-8d1c-3979d9f03e7a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.617013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb8cec-061f-4a5f-8d1c-3979d9f03e7a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.621959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.623104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.623583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.624052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.627392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be56d6-655b-4290-9d2b-53889cf7dd25 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.627920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be56d6-655b-4290-9d2b-53889cf7dd25 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.630200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be56d6-655b-4290-9d2b-53889cf7dd25 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.630200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 101/205] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:55.635714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.636002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.636280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.637590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:55.645317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:55.647056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 105/206] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:55.655497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.656407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:55.657816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:55.666169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0b7c9-b64a-440b-a041-8a1f47ff762d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.667353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 102/207] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:55.677287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.678267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.678829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.679329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.680318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:55.680852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.682729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.692235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.695868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 106/208] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:55.701763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56dc73f-f1b8-4a16-a78d-07b8d1f6a0e5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.702434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.706335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.707684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.707961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.708231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.709638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.711362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.713116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 103/209] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:55.715286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91413caf-9867-4f81-a590-aa31ce4ea26e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.719221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.722401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.724119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.724618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.725122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.726644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.729194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.729405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd1eb-8ecf-4c1b-a31e-7ee4e442c063 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.731467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 107/210] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:55.735699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.735699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.735699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.735699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] PATH_INFO: `/v3/groups` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.736128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.737095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:55.737095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:55.737095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:55.738671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca4067-d668-46b7-ab57-cd2315943c5f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.739031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.749506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0337e-332e-4ac2-b796-eea097765c8c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.753980 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.754953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.755306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.755731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.756957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.759051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.760795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 108/211] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:55 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:55.766513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:55.776505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee03d0-86e3-4a89-8ec2-5d9e7118957f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:55.780943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3902c9-18aa-4051-a627-1c22db0b5a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:55.781839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3902c9-18aa-4051-a627-1c22db0b5a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:55.782128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3902c9-18aa-4051-a627-1c22db0b5a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:55.782405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3902c9-18aa-4051-a627-1c22db0b5a16 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a/users/9c21df549a3c46648a2d1e3963e9091b/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:55.784643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3902c9-18aa-4051-a627-1c22db0b5a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1cb09c40f542528bcf1e352639c35a, user_id=9c21df549a3c46648a2d1e3963e9091b, role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:55.787779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3902c9-18aa-4051-a627-1c22db0b5a16 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:55.853480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 104/212] 10.222.0.16 () {60 vars in 1156 bytes} [Tue Aug 10 04:57:55 2021] POST /identity/v3/groups => generated 226 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:57:55.884250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 109/213] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:57:55 2021] PUT /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a/users/9c21df549a3c46648a2d1e3963e9091b/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 04:57:57.134236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3d04-0d5a-4446-81ba-c4324e701191 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.134771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3d04-0d5a-4446-81ba-c4324e701191 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.134844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3d04-0d5a-4446-81ba-c4324e701191 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.136957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 105/214] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:57.143200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.143589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.143801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.162193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:57.163382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:57.237104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 110/215] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:57.263683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3d04-0d5a-4446-81ba-c4324e701191 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.278171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3d04-0d5a-4446-81ba-c4324e701191 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.282732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.283530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.283805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.284074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.297334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:57.304766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:57.306163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 106/216] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:57.312477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.324103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d5a3d-109a-4903-9bf6-e5974a1b74d0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.328589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.329253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.329534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.329805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.330551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:57.330875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.332621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.342891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 111/217] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:57.348110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.360647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f198ad1-73bc-49c6-a383-77af3b05643d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.365732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.366637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.366922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.367192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.368392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.370552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.375062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 107/218] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:57.381421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.391301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277bce-c86c-4995-8559-13da10de3b02 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.396971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.397664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.397946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.398221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.408515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.410280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.419624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 112/219] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:57.426432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.438494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e07f4e4-3dcb-4953-9a81-596ead0d485a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.445593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe033df-b52b-450b-8f33-1fba5b66449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.446453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe033df-b52b-450b-8f33-1fba5b66449a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.446797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe033df-b52b-450b-8f33-1fba5b66449a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.447069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe033df-b52b-450b-8f33-1fba5b66449a admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.448259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe033df-b52b-450b-8f33-1fba5b66449a admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.450298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe033df-b52b-450b-8f33-1fba5b66449a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.452185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 108/220] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:57.458776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.468259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effb31-e7f3-4649-93f6-ec7c5f502772 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.472744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.473428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.473763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.474038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.474970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] RBAC: Adding query filter params (role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=bd1cb09c40f542528bcf1e352639c35a, user.id=9c21df549a3c46648a2d1e3963e9091b) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:57.475276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.477191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2710692-fb77-4d5d-a3fe-8b7005bf8d85 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.483673 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 113/221] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/role_assignments?user.id=9c21df549a3c46648a2d1e3963e9091b&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:57.772022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67badf-8032-44da-8afc-933a700ebcba None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.772383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67badf-8032-44da-8afc-933a700ebcba None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.772575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67badf-8032-44da-8afc-933a700ebcba None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.774364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 109/222] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:57.780625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.780913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.781190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.811386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:57.812681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:57.825834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 114/223] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:57.851880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67badf-8032-44da-8afc-933a700ebcba None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.865023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67badf-8032-44da-8afc-933a700ebcba None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.869444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.870231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.870512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.870809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.885253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:57.892302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:57:57.893574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 110/224] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:57.900430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.909526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa274b-20f0-41cf-93aa-809652bd67f7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.918589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.919261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.919547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.919815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.920592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:57.920897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.922504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.934077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 115/225] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:57.940527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.950890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012b1fa-1764-4feb-9d56-c92b58eaf602 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.955420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.956289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.956566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.956837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.958556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.960627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:57.962389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 111/226] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:57.968745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:57.979205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4740e-7564-4a34-9dba-4bcdcc406b6a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:57.987730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:57.988385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:57.988776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:57.989005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:57.997599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:57.999446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.009971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 116/227] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:58.016869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.033649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e9dc3-a15c-455b-b529-6f669010c3e5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.038965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d269acf-5fcf-4203-bf72-34849f6877f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.039912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d269acf-5fcf-4203-bf72-34849f6877f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.040189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d269acf-5fcf-4203-bf72-34849f6877f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.040457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d269acf-5fcf-4203-bf72-34849f6877f7 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.041687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d269acf-5fcf-4203-bf72-34849f6877f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:58.043944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d269acf-5fcf-4203-bf72-34849f6877f7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.047909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 112/228] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:58.054079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.063299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34769e19-7a10-4269-916f-20413a74add8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.067996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.068692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.068975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.069297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.070173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=bd1cb09c40f542528bcf1e352639c35a, user.id=ea2c6493cbbf4f86bef2484d6a25608e) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:58.070487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:58.072415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8c130-0b32-442b-8dbe-ea70f8235b7c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.078723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 117/229] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/role_assignments?user.id=ea2c6493cbbf4f86bef2484d6a25608e&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:57:58.699963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286bbdf-3e30-4517-8db1-f1f157b0b510 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.700631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286bbdf-3e30-4517-8db1-f1f157b0b510 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.700631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286bbdf-3e30-4517-8db1-f1f157b0b510 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.702545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 113/230] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:58.713521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.714152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.714152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.733754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:58.734956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:58.746277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 118/231] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:57:58.782725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286bbdf-3e30-4517-8db1-f1f157b0b510 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.795839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286bbdf-3e30-4517-8db1-f1f157b0b510 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.800305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.801138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.801413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.801746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.817481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:58.824747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:58.827024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 114/232] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:58.832950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.842375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b3d44-bea7-4a14-8c55-09d6933e70d5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.847225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.847960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.848237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.848511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.849259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:58.849558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:58.851178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.866517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 119/233] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:58.872855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.882952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629afeaa-a668-4948-89d9-89cc97c25547 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.890675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.891563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.891894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.892173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.893520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:58.896250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.898048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 115/234] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:58.904427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.914417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd143686-5e2d-4273-8bfb-3f0575813e40 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.919648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.920299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.920575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.920845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.930117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:58.931996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.942302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 120/235] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:58.948788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.963019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83a900-cd71-4448-96c3-64032c721e9a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:58.969010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e72e1-5b43-4efc-b28a-adc551cb9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:58.969909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e72e1-5b43-4efc-b28a-adc551cb9f4f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:58.970237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e72e1-5b43-4efc-b28a-adc551cb9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:58.970556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e72e1-5b43-4efc-b28a-adc551cb9f4f admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:58.972713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e72e1-5b43-4efc-b28a-adc551cb9f4f admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:58.974941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e72e1-5b43-4efc-b28a-adc551cb9f4f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:58.976946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 116/236] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:58.984295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:58.994525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e7807-9092-4efe-8531-141de986e608 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.000422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.001071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.001359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.001852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.002756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] RBAC: Adding query filter params (role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=bd1cb09c40f542528bcf1e352639c35a, user.id=9c21df549a3c46648a2d1e3963e9091b) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:59.014549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.014549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ede5a-b000-4abc-b92c-6a4b60110260 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.015306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 121/237] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:57:58 2021] GET /identity/v3/role_assignments?user.id=9c21df549a3c46648a2d1e3963e9091b&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.255695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452b317-3d59-45ea-8654-d4ca0c87b06a None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.256102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452b317-3d59-45ea-8654-d4ca0c87b06a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.256269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452b317-3d59-45ea-8654-d4ca0c87b06a None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.258064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 117/238] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:57:59.264639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.264923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.265200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.288033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:59.289309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:59.300442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 122/239] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:59.328152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452b317-3d59-45ea-8654-d4ca0c87b06a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.342183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452b317-3d59-45ea-8654-d4ca0c87b06a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.346840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.347679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.348407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.348687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.364682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:59.371771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:57:59.373026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 118/240] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:59.380202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.391163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f2b7b-b9ea-47d4-83cc-8dca1904fee3 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.396459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.397233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.397515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.397779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.398526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:59.398904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.400493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.414524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 123/241] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.420439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.432143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a89f95-7fad-44c9-a39c-c542285a5e7f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.439829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.440593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.440871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.441143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.454658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.456493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.471602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 119/242] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:59.477590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.493144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f23c-11a4-4710-8f86-8c2cabacf85a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.502395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.503127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.503409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.503682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.507538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.509588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.511814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 124/243] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.521597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.531666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb111b-bcb2-4dc8-ac00-2f874e84904b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.539327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.540304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.540642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.540914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.548702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.549793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:59.549793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:57:59.549793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:57:59.551654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f0756-cc4f-4437-a3fa-a05b39c47788 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.553383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 120/244] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.560728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.565197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb54c6-6010-4e9c-a2f7-e4640357436e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.565536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb54c6-6010-4e9c-a2f7-e4640357436e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.565810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb54c6-6010-4e9c-a2f7-e4640357436e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.568378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 121/245] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:57:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:57:59.575541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.575827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.576104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.577480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28012cfe-e716-4c9e-89f7-43e0042b1c46 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.588215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.588884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.589162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.589434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.590272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:59.590603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.592452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.600259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:57:59.601749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:57:59.602986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 125/246] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.628784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 122/247] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:57:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:57:59.675104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.692065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b37f1-4771-422b-9bc6-afb0afd7c32d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.697710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.698538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.698846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.699123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.715334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:57:59.723964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:57:59.725588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 126/248] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:57:59.731927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.741680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf9363-1fdf-4f75-877e-7671cbee59ee None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.751066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.751767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.752050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.752327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.753104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:59.753416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.755143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.764910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 123/249] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.771767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.785070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41917124-f2c3-43bd-af60-5c72e16db566 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.795050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.795727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.796008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.796277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.811290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.813281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.828181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 127/250] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:57:59.835445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.848081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fd806-d5f1-4ecf-a07e-7acb644902e9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.860509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.861958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.862438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.862949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.866556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.868691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.870798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 124/251] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.881581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.886903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7bad9-6375-4c2e-b09c-bd23948b47bd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.891578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.892660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.893156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.893652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.895642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.896845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:57:59.896845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:57:59.896845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:57:59.898320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae118735-f668-4264-8465-5656a20100a1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.901930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 128/252] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:57:59.908293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:57:59.918292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d8a66-7d22-4c9c-a195-8fd63b8f4c94 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:57:59.930861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:57:59.931532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:57:59.931815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:57:59.932091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:57:59.932933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:57:59.933247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:57:59.935134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8520258f-4bb4-4c3c-b2a8-77bd908fadee admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:57:59.941511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 125/253] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:57:59 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:00.331031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c62987-38be-477d-8106-f3d8798bd6de None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.331699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c62987-38be-477d-8106-f3d8798bd6de None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.332699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c62987-38be-477d-8106-f3d8798bd6de None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.335276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 129/254] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:00.341219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.341517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.341800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.367610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:00.368826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:00.377013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 126/255] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:00.411837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c62987-38be-477d-8106-f3d8798bd6de None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.431441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c62987-38be-477d-8106-f3d8798bd6de None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.436294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.437344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.437913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.438385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.454251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:00.462220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:58:00.465865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 130/256] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:00.472383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.489339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2cd8f-cd45-4600-8d8c-8af6c6941606 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.495607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.496296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.496582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.496861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.497681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:00.497991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:00.499673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:00.516243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 127/257] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:00.523830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.543339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c4b1b-22e6-4795-9cbd-1809355188a1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.554963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.555622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.555905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.556179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.572190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:00.573986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:00.587653 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 131/258] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:00.593944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.610158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75e3cc-1483-42de-880c-18bc36fc36f7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.619211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.620134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.620420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.620744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.621927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:00.624147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:00.626261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 128/259] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:00.632973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.642113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad50c8-f3f2-4619-8289-a44efff2ef49 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.653877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444284-fbc2-453f-b042-912b53a50747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.654771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444284-fbc2-453f-b042-912b53a50747 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.655049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444284-fbc2-453f-b042-912b53a50747 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.655309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444284-fbc2-453f-b042-912b53a50747 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.659273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444284-fbc2-453f-b042-912b53a50747 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:00.661879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444284-fbc2-453f-b042-912b53a50747 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:00.663521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 132/260] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:00.670121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.683802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48bf94f-fbf2-45dd-b708-7495aa468fcc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.694709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.695379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.695662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.695935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.696770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=bd1cb09c40f542528bcf1e352639c35a) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:00.697081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:00.698977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab0a6d-0491-46fb-b514-4947db16015e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:00.704941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 129/261] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:00.858084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312312da-9f43-4aae-8bef-8d6174ca0c8b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.858786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312312da-9f43-4aae-8bef-8d6174ca0c8b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.858786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312312da-9f43-4aae-8bef-8d6174ca0c8b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.860713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 133/262] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:00.867970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.868919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.869419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:00.908079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:00.909638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:00.922211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 130/263] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:00.960946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312312da-9f43-4aae-8bef-8d6174ca0c8b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:00.980517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312312da-9f43-4aae-8bef-8d6174ca0c8b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:00.984976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:00.985781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:00.986063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:00.986327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.000265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:01.007671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:58:01.009214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 134/264] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:00 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:01.015432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.030432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6377c886-aff0-4bbb-9ea6-d37d4594fccf None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.035922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.036885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.037363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.037864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.038848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:01.039367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.041152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.054799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 131/265] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.060609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.075760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0faf94f-2fb8-4ca4-b0e5-2155e1a71079 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.084550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.085249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.085533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.085809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.101791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.103679 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.113818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 135/266] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:01.119887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.135613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c374f6-09a4-49fd-b45d-e1bbfefd2007 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.140342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.141454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.141929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.142394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.147961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.150244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.152184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 132/267] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.158883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.168742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f7b27-604f-4744-a2a9-7fcf2459b21e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.179024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b3ba1-a6cc-4ee3-83ac-97bb2b05cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.180115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b3ba1-a6cc-4ee3-83ac-97bb2b05cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.180394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b3ba1-a6cc-4ee3-83ac-97bb2b05cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.180666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b3ba1-a6cc-4ee3-83ac-97bb2b05cf13 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.187364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b3ba1-a6cc-4ee3-83ac-97bb2b05cf13 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.189456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b3ba1-a6cc-4ee3-83ac-97bb2b05cf13 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.191211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 136/268] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.197892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.212464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31615b4-cb71-475a-8f8d-c421bf78738c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.217143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.218035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.218512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.219014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.226601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=bd1cb09c40f542528bcf1e352639c35a) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:01.227075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.228969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65092717-2eb4-4f11-8609-a15668d007b4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.240979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 133/269] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 260 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.588409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01561a-56ff-4d75-a14e-7a0178e63851 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.588697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01561a-56ff-4d75-a14e-7a0178e63851 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.588958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01561a-56ff-4d75-a14e-7a0178e63851 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.591048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 137/270] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:01.596886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.597173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.597451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.623613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:01.624807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:01.632991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 134/271] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:01.669343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01561a-56ff-4d75-a14e-7a0178e63851 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.688252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01561a-56ff-4d75-a14e-7a0178e63851 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.692981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.693786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.694070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.694402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.711501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:01.718514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:01.719769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 138/272] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:01.726778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.735869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82bdf0-ac5e-41f6-a1ec-413a05a5023f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.747123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.747796 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.748074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.748347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.749099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:01.749403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.751100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.767128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 135/273] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.773734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.789166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ed8c73-5b73-41e0-b9d8-a23329bf37f0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.799851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.800583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.800869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.801182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.812663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.814697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.829237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 139/274] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:01.835952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.849843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d637b4-0562-4908-b9a7-a1e8b0604083 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.858548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.859427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.859707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.859978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] PATH_INFO: `/v3/projects/8beb590f33a341adaea78fed778aaecf` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.861792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=8beb590f33a341adaea78fed778aaecf)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.863664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.865542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 136/275] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/projects/8beb590f33a341adaea78fed778aaecf => generated 344 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.871750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.881275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d8f12-cf15-4104-88d5-08a9de3e26f8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.889893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93626-5c5e-430c-88e9-6e0850c0aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.890782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93626-5c5e-430c-88e9-6e0850c0aa05 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.891113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93626-5c5e-430c-88e9-6e0850c0aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.891387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93626-5c5e-430c-88e9-6e0850c0aa05 admin admin] PATH_INFO: `/v3/groups/ec5cf3c1f9e8484bb75e7255952c843c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.903326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93626-5c5e-430c-88e9-6e0850c0aa05 admin admin] RBAC: Authorizing `identity:get_group(group_id=ec5cf3c1f9e8484bb75e7255952c843c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.905415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93626-5c5e-430c-88e9-6e0850c0aa05 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.907221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 140/276] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/groups/ec5cf3c1f9e8484bb75e7255952c843c => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:01.914570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:01.924651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c690ab8-d1c9-49f8-b507-7e171a1e29e0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:01.939265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:01.939943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:01.940224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:01.940493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:01.941378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] RBAC: Adding query filter params (group.id=ec5cf3c1f9e8484bb75e7255952c843c, role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=8beb590f33a341adaea78fed778aaecf) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:01.941719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:01.943781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432abaf5-cc73-4da5-8fc4-41e7030bfb2f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:01.950937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 137/277] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:01 2021] GET /identity/v3/role_assignments?group.id=ec5cf3c1f9e8484bb75e7255952c843c&scope.project.id=8beb590f33a341adaea78fed778aaecf&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:02.299672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdda5-5ae2-49f2-a631-5ec1b778c744 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.300033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdda5-5ae2-49f2-a631-5ec1b778c744 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.300243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdda5-5ae2-49f2-a631-5ec1b778c744 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.302607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 141/278] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:02.309269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.309570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.309817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.336950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:02.339000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:02.350270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 138/279] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:02.377481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdda5-5ae2-49f2-a631-5ec1b778c744 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:02.398448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdda5-5ae2-49f2-a631-5ec1b778c744 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:02.404392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:02.405192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.405475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.405754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.419374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:02.426398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:58:02.427936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 142/280] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:02.434282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:02.448854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b2a97-49d5-484d-ae88-f429e36a5323 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:02.460426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:02.461105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.461384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.461653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.462409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:02.462739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:02.464346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:02.473411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 139/281] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:58:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:02.480271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:02.497144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a4c9c-ebfc-4153-aa18-0797b40845e7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:02.502779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:02.503735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.504019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.504886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.507476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:02.509522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:02.511401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 143/282] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:02 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:02.521601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:02.531516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fde6a-d39e-4bcf-9a8d-7f20c0eb9ae2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:02.547881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3524d0-9799-43e2-a47d-b48c6495d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:02.548757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3524d0-9799-43e2-a47d-b48c6495d0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.549038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3524d0-9799-43e2-a47d-b48c6495d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.549312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3524d0-9799-43e2-a47d-b48c6495d0b2 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.551716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3524d0-9799-43e2-a47d-b48c6495d0b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:02.553772 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3524d0-9799-43e2-a47d-b48c6495d0b2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:02.555686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 140/283] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:02 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:02.562092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:02.586162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8462d206-ab84-4542-84c5-84d58cd22892 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:02.598606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593d5e8-8052-4378-b62d-9a937acd8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:02.598606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593d5e8-8052-4378-b62d-9a937acd8944 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.598996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593d5e8-8052-4378-b62d-9a937acd8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.599166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593d5e8-8052-4378-b62d-9a937acd8944 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/groups/03562f465bf64d86bba02234ce94a995/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.603931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593d5e8-8052-4378-b62d-9a937acd8944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0498e0a8099f45c7870d1f5f8ad93fd1, group_id=03562f465bf64d86bba02234ce94a995, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:02.606952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593d5e8-8052-4378-b62d-9a937acd8944 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:02.693740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 144/284] 10.222.0.16 () {58 vars in 1464 bytes} [Tue Aug 10 04:58:02 2021] PUT /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/groups/03562f465bf64d86bba02234ce94a995/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:02.909261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ed21-3a55-41e2-9df1-fa7c4c9f1429 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.909451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ed21-3a55-41e2-9df1-fa7c4c9f1429 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.909724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9208ed21-3a55-41e2-9df1-fa7c4c9f1429 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.912462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 141/285] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:02.918757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:02.919644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:02.920122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:02.947688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:02.949282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:03.023204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 145/286] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:03.048430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ed21-3a55-41e2-9df1-fa7c4c9f1429 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.078771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9208ed21-3a55-41e2-9df1-fa7c4c9f1429 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.083493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.084565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.084846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.085117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.099260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:03.106531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:58:03.115758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 142/287] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:03.122383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.134603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33debc-6cdd-497b-8764-3e780fe50294 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.143721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.144722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.145202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.145671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.146697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:03.147251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.149070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.159564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 146/288] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:03.166078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.179390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996232d3-b444-4539-8d94-255bcf425af9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.186884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.188093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.188624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.189100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.190546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.193368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.195601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 143/289] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:03.201329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.212383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0f9ab-3327-4caf-bc62-baab2c0c8681 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.219913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619f941-4e82-4b93-b423-c3f5510d3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.221097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619f941-4e82-4b93-b423-c3f5510d3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.221560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619f941-4e82-4b93-b423-c3f5510d3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.222042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619f941-4e82-4b93-b423-c3f5510d3fd5 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.223540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619f941-4e82-4b93-b423-c3f5510d3fd5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.226009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619f941-4e82-4b93-b423-c3f5510d3fd5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.228054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 147/290] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:03.234313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.245517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931b274-60ab-4439-90c9-5291ef4a9749 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.251225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be116ac-aff5-45e3-b44c-a25eb4e7ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.252372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be116ac-aff5-45e3-b44c-a25eb4e7ddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.252854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be116ac-aff5-45e3-b44c-a25eb4e7ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.253349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be116ac-aff5-45e3-b44c-a25eb4e7ddb2 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/groups/03562f465bf64d86bba02234ce94a995/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.257365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be116ac-aff5-45e3-b44c-a25eb4e7ddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0498e0a8099f45c7870d1f5f8ad93fd1, group_id=03562f465bf64d86bba02234ce94a995, role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.261132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be116ac-aff5-45e3-b44c-a25eb4e7ddb2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.360018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 144/291] 10.222.0.16 () {58 vars in 1464 bytes} [Tue Aug 10 04:58:03 2021] PUT /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1/groups/03562f465bf64d86bba02234ce94a995/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:03.598834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e5363-4431-4346-b297-c2aa2c9ece17 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.599456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e5363-4431-4346-b297-c2aa2c9ece17 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.599930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e5363-4431-4346-b297-c2aa2c9ece17 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.602236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 148/292] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:03.608774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.609061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.609339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.629767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:03.630991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:03.698834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 145/293] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:03.721234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e5363-4431-4346-b297-c2aa2c9ece17 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.738790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e5363-4431-4346-b297-c2aa2c9ece17 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.743333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.744225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.744600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.744949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.760169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:03.767296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:58:03.768868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 149/294] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:03.776078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.787757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bcf23-ac0c-458b-9b22-08434b374d3d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.800072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.801066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.801544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.802050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.803026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:03.803530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.805319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.818944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 146/295] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:03.825552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.842301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efd90a-9d2b-4753-9b5b-e109a0942005 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.847470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.848420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.848711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.848985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.851234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.853251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.855165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 150/296] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:03.861399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.874912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be72f4-dd79-484e-a514-9f0321442fd6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.883095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07825339-2644-4034-a21e-ea435d39e5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.884226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825339-2644-4034-a21e-ea435d39e5cf admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.884707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825339-2644-4034-a21e-ea435d39e5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.885176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07825339-2644-4034-a21e-ea435d39e5cf admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.886565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825339-2644-4034-a21e-ea435d39e5cf admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.888865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07825339-2644-4034-a21e-ea435d39e5cf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:03.894675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 147/297] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:03 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:03.898134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:03.909281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba360784-f9f2-4777-b386-82a9020d5024 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:03.922377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe9898-b73a-4e28-a0d0-1c3ab9c52c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:03.923314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe9898-b73a-4e28-a0d0-1c3ab9c52c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:03.923662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe9898-b73a-4e28-a0d0-1c3ab9c52c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:03.923949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe9898-b73a-4e28-a0d0-1c3ab9c52c53 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a/groups/03562f465bf64d86bba02234ce94a995/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:03.927403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe9898-b73a-4e28-a0d0-1c3ab9c52c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1cb09c40f542528bcf1e352639c35a, group_id=03562f465bf64d86bba02234ce94a995, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:03.930137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe9898-b73a-4e28-a0d0-1c3ab9c52c53 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:04.017537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 151/298] 10.222.0.16 () {58 vars in 1464 bytes} [Tue Aug 10 04:58:03 2021] PUT /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a/groups/03562f465bf64d86bba02234ce94a995/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:04.044634 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45e851-2804-4eb8-b9b1-ea7c51bb787f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.045354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45e851-2804-4eb8-b9b1-ea7c51bb787f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.045948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45e851-2804-4eb8-b9b1-ea7c51bb787f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.048316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 148/299] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:04.056542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.056842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.057113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.079672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:04.080906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:04.158307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 152/300] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:04.194273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45e851-2804-4eb8-b9b1-ea7c51bb787f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:04.216321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45e851-2804-4eb8-b9b1-ea7c51bb787f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:04.224825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:04.226066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.226544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.227103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.241169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:04.249037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:58:04.250448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 149/301] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:04.257000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:04.270636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26277c-6789-4be4-b1f2-454fd983f4ad None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:04.278655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:04.279330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.279611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.279882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.280637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:04.280943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:04.282554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:04.299170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 153/302] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:04.304432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:04.319918 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e73236-2a52-4372-a1c3-c0d6bd32bf03 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:04.325131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:04.326175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.326628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.327044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.328345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:04.336048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:04.337994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 150/303] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:04 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:04.344237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:04.357422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87565bec-7eb6-4b24-ab04-8a385740dd07 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:04.363842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b39f5-f179-4bb2-abfa-7d35b3821858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:04.364702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b39f5-f179-4bb2-abfa-7d35b3821858 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.365033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b39f5-f179-4bb2-abfa-7d35b3821858 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.365303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b39f5-f179-4bb2-abfa-7d35b3821858 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.366522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b39f5-f179-4bb2-abfa-7d35b3821858 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:04.368762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b39f5-f179-4bb2-abfa-7d35b3821858 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:04.370474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 154/304] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:04 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:04.376733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:04.391566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1c9c5-97ca-41e4-8a78-205c22532169 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:04.402620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0b19e-8cab-4320-916f-058b7142feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:04.403734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0b19e-8cab-4320-916f-058b7142feb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.404225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0b19e-8cab-4320-916f-058b7142feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.404717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0b19e-8cab-4320-916f-058b7142feb3 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a/groups/03562f465bf64d86bba02234ce94a995/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.407135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0b19e-8cab-4320-916f-058b7142feb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1cb09c40f542528bcf1e352639c35a, group_id=03562f465bf64d86bba02234ce94a995, role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:04.409966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0b19e-8cab-4320-916f-058b7142feb3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:04.525225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 151/305] 10.222.0.16 () {58 vars in 1464 bytes} [Tue Aug 10 04:58:04 2021] PUT /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a/groups/03562f465bf64d86bba02234ce94a995/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:04.970798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abd2e-8c3d-4b9a-9da9-b765b5505a99 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.971783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abd2e-8c3d-4b9a-9da9-b765b5505a99 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.972450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9abd2e-8c3d-4b9a-9da9-b765b5505a99 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:04.974493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 155/306] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:04 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:04.980709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:04.981271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:04.981759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.000266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:05.001771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:05.082079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 152/307] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:05.123547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abd2e-8c3d-4b9a-9da9-b765b5505a99 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.140375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9abd2e-8c3d-4b9a-9da9-b765b5505a99 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.145117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.146141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.146652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.147272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.159631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:05.167250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:05.168661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 156/308] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:05.174973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.185168 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5876f-7348-424d-92a8-2c6f58b4d080 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.199279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.199980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.200249 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.200527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.201297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:05.201600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:05.203251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:05.216757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 153/309] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:05.223469 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.238296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581644f2-8f35-4637-aacd-a76bfbe66f02 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.247265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.248156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.248413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.248689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] PATH_INFO: `/v3/groups/ec5cf3c1f9e8484bb75e7255952c843c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.251314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] RBAC: Authorizing `identity:get_group(group_id=ec5cf3c1f9e8484bb75e7255952c843c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:05.253299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:05.255875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 157/310] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/groups/ec5cf3c1f9e8484bb75e7255952c843c => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:05.261574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.275723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea688c1-1976-4e50-961c-80a94bad4175 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.283174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6eef6-7039-484a-8631-39310dc746c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.284045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6eef6-7039-484a-8631-39310dc746c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.284328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6eef6-7039-484a-8631-39310dc746c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.284601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6eef6-7039-484a-8631-39310dc746c3 admin admin] PATH_INFO: `/v3/projects/8beb590f33a341adaea78fed778aaecf` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.291375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6eef6-7039-484a-8631-39310dc746c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=8beb590f33a341adaea78fed778aaecf)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:05.293223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6eef6-7039-484a-8631-39310dc746c3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:05.295301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 154/311] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/projects/8beb590f33a341adaea78fed778aaecf => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:05.301864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.312111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ac895-dc8d-4279-90e2-ab5a7d61eb2c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.321612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afdbddf-7fa7-4dc5-a5b0-141d881265eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.322504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdbddf-7fa7-4dc5-a5b0-141d881265eb admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.322811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdbddf-7fa7-4dc5-a5b0-141d881265eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.323094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afdbddf-7fa7-4dc5-a5b0-141d881265eb admin admin] PATH_INFO: `/v3/projects/8beb590f33a341adaea78fed778aaecf/groups/ec5cf3c1f9e8484bb75e7255952c843c/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.327348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdbddf-7fa7-4dc5-a5b0-141d881265eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8beb590f33a341adaea78fed778aaecf, group_id=ec5cf3c1f9e8484bb75e7255952c843c, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:05.329989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afdbddf-7fa7-4dc5-a5b0-141d881265eb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:05.408467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 158/312] 10.222.0.16 () {58 vars in 1464 bytes} [Tue Aug 10 04:58:05 2021] PUT /identity/v3/projects/8beb590f33a341adaea78fed778aaecf/groups/ec5cf3c1f9e8484bb75e7255952c843c/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:05.700859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0b07c-8b72-41e3-a721-53efe852ac53 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.701260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0b07c-8b72-41e3-a721-53efe852ac53 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.701457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb0b07c-8b72-41e3-a721-53efe852ac53 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.703673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 155/313] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:05.711352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.711646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.711916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.732443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:05.733712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:05.801711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 159/314] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:05.825582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0b07c-8b72-41e3-a721-53efe852ac53 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.847061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb0b07c-8b72-41e3-a721-53efe852ac53 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.857341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.858450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.858998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.859467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.875795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:05.884054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:58:05.889992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 156/315] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:05.892357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.902876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e40fc-a6ae-4810-b827-4bdfe9168f3a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.917014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.920282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.920282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.920282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.920282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:05.920282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:05.921005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818102-ca54-41d2-82a1-f20b05addd48 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:05.935067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 160/316] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:05.940813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:05.955637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c450b1-0842-4214-bc37-7a14a4ec341f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:05.957831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90cb4-8958-4b6b-9738-fea55762c869 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.958128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90cb4-8958-4b6b-9738-fea55762c869 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.958431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e90cb4-8958-4b6b-9738-fea55762c869 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.960508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 161/317] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:05.967527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.967783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.968062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.974781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:05.975437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:05.975720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:05.975995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:05.993844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:05.995724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.006492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:06.007708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:06.013749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 157/318] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:06.020021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.024331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 162/319] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:06.034000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec083b7-22db-4870-8247-ba4056ad8705 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.044025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.044871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.045156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.045425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.046628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.049378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.050318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 158/320] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:06.056478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.065995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91897c2f-57a4-4e8c-babb-9da1df559c95 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.074631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.075487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.075768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.076043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.077214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.079150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.080945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 163/321] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:06.086074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.092733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.101137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03f63b-3a3c-408b-87da-d8e7f8e28134 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.107874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.109023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.109195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6882-b4ff-41e7-a20a-19a746642e2c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.109884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.110410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.113803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.114509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.114895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.115242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.116131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:06.116509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.124659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.124659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 164/322] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:06.131477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:06.144536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:58:06.146288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 159/323] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:06.153091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.168915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2af29-5e5d-4e3c-8fb9-546310c652e8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.184391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.185075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.185361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.185632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.186389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:06.186719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.188320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.201509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 165/324] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:06.207809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.220029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc9b31-c64c-4a0a-a5be-518a06e6dd1c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.234453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.235603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.236185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.236653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.253145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.255467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.266500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 160/325] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:06.273467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.288259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b501d-f236-425a-937d-d4b807d8f113 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.292886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.293743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.294023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.294299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.299467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.302094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.304218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 166/326] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:06.310247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.324092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f06ef-12c0-41ea-ac33-766877744b23 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.334956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d4136-c376-437f-83b0-00abffee4572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.335852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d4136-c376-437f-83b0-00abffee4572 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.336133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d4136-c376-437f-83b0-00abffee4572 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.336431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d4136-c376-437f-83b0-00abffee4572 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.339511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d4136-c376-437f-83b0-00abffee4572 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.341478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d4136-c376-437f-83b0-00abffee4572 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.343569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 161/327] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:06.349845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.364904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b5cc9-d3aa-44f2-8abd-9e0f9c5c21f4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.378400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.379266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.379558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.379822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.380657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:06.380965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.382854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42014a-2120-4160-b8ea-8ae9c63afc44 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.389290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 167/328] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:06.823804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcdd16-9444-40af-8525-0fb6565a686f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.824139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcdd16-9444-40af-8525-0fb6565a686f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.824350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcdd16-9444-40af-8525-0fb6565a686f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.826332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 162/329] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:06.833065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.833703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.834179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.853775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:06.855324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:06.866385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 168/330] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:06.889638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcdd16-9444-40af-8525-0fb6565a686f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.902227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcdd16-9444-40af-8525-0fb6565a686f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.906684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.907550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.907907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.908245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.919959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:06.926884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 10 04:58:06.928089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 163/331] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:06.934736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.945957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34035705-d987-496a-bc6b-e226fdf45866 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.950517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.951222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.951489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.951759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.952567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] RBAC: Adding query filter params (name=member) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:06.952875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.954661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:06.965116 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 169/332] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:06.971226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:06.981906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a2003e-0ac6-42a2-b74b-db5a887eef7f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:06.986437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:06.987114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:06.987434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:06.987762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:06.997714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:06.999536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.008664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 164/333] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:58:07.014845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.024987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6df9b-edc3-4e4a-8301-13c117ee21de admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.029212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.030055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.030335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.030624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.031776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.033819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.036211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 170/334] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.041946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.050798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a4c06-55dd-4f74-8940-8bdd2c371e2d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.055326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155ff6c-9827-46e4-98dd-5946df29fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.056266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155ff6c-9827-46e4-98dd-5946df29fdfe admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.056548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155ff6c-9827-46e4-98dd-5946df29fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.056824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155ff6c-9827-46e4-98dd-5946df29fdfe admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.058073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155ff6c-9827-46e4-98dd-5946df29fdfe admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.060148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155ff6c-9827-46e4-98dd-5946df29fdfe admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.062011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 165/335] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:07.068127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.077821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f554dbf-ae6e-4f1e-8729-738e4988e7fa admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.082724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.083455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.083735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.084001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.085072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=488e5f4e99c9415d9d28f5e7b137c2a3, scope.project.id=bd1cb09c40f542528bcf1e352639c35a) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:07.085379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.087233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967ff59-4df1-4711-b941-25eaa58d2679 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.092972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 171/336] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=488e5f4e99c9415d9d28f5e7b137c2a3 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.332472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391e3f-800a-45af-a920-a38becd62d5a None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.332965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391e3f-800a-45af-a920-a38becd62d5a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.332965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2391e3f-800a-45af-a920-a38becd62d5a None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.335169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 166/337] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:07.340959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.341247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.341519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.359517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:07.360685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:07.368257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:07.394478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391e3f-800a-45af-a920-a38becd62d5a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.407743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2391e3f-800a-45af-a920-a38becd62d5a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.412749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.413598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.413887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.414155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.426549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:07.433904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:58:07.435320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 167/339] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:07.442106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.451509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20185e5a-7b0a-4fdd-a9c3-a50102f3d13b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.455952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.456614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.456893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.457161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.458455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:07.458796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.460649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.469503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 173/340] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.476590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.486323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc13a9-1628-4b68-a6d1-0b74715b677a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.490687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.491322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.491602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.491872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.500143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.501878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.510933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 168/341] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:58:07.517115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.527446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5fed6-3314-47dd-b979-dfb59b2602ab admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.531846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.532690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.532969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.533237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.534422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.536506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.538158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 174/342] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.544100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.552888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe09e33-84bf-42da-b41a-11ea52075ca2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.557150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12e3ce-fb85-4f3e-8a20-99a31fec19c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.557981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12e3ce-fb85-4f3e-8a20-99a31fec19c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.558260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12e3ce-fb85-4f3e-8a20-99a31fec19c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.558534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12e3ce-fb85-4f3e-8a20-99a31fec19c7 admin admin] PATH_INFO: `/v3/groups/03562f465bf64d86bba02234ce94a995` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.559759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12e3ce-fb85-4f3e-8a20-99a31fec19c7 admin admin] RBAC: Authorizing `identity:get_group(group_id=03562f465bf64d86bba02234ce94a995)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.561637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12e3ce-fb85-4f3e-8a20-99a31fec19c7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.563391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 169/343] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/groups/03562f465bf64d86bba02234ce94a995 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.569625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.578945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64d308-3945-4c47-a529-9c2b30870ede admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.583826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.584647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.584925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.585215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.586010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] RBAC: Adding query filter params (group.id=03562f465bf64d86bba02234ce94a995, role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=bd1cb09c40f542528bcf1e352639c35a) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:07.586314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.588165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba9af7d-73a6-43d6-b207-7ad342bb6d9f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.593640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 175/344] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/role_assignments?group.id=03562f465bf64d86bba02234ce94a995&scope.project.id=bd1cb09c40f542528bcf1e352639c35a&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.807894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3312aec-cd85-4965-840c-66104eda7e75 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.808179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3312aec-cd85-4965-840c-66104eda7e75 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.808472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3312aec-cd85-4965-840c-66104eda7e75 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.810316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 170/345] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:07.816372 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.816656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.816932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.835440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:07.836541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:07.844158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 176/346] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:07.869036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3312aec-cd85-4965-840c-66104eda7e75 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.881195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3312aec-cd85-4965-840c-66104eda7e75 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.885640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.886464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.886784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.887061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.898121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:07.905135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:07.906680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 171/347] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:07.913157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.922180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d045c2-1014-4658-9fa2-69c2c65f6b4b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.927253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.927907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.928192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.928468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.929220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:07.929527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.931202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.939875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 177/348] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:07.946067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.955839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a0e9f-efef-4651-bff4-3f4d69f83f86 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:07.960883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:07.961512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:07.961797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:07.962074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:07.970187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:07.972129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:07.981332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 172/349] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:07.987276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:07.996607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc0968-8162-41c4-8d44-f1997092914e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:08.000923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:08.001758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:08.002043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:08.002317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] PATH_INFO: `/v3/projects/8beb590f33a341adaea78fed778aaecf` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:08.003512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] RBAC: Authorizing `identity:get_project(project_id=8beb590f33a341adaea78fed778aaecf)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:08.005278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:08.006935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 178/350] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:07 2021] GET /identity/v3/projects/8beb590f33a341adaea78fed778aaecf => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:08.012372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:08.021284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3a73e1-356a-4e2f-8613-5036a7da7d2a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:08.025532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4d886-0839-4cfd-93e6-29364e5d178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:08.026346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d886-0839-4cfd-93e6-29364e5d178f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:08.026657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d886-0839-4cfd-93e6-29364e5d178f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:08.026934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4d886-0839-4cfd-93e6-29364e5d178f admin admin] PATH_INFO: `/v3/groups/ec5cf3c1f9e8484bb75e7255952c843c` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:08.028089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d886-0839-4cfd-93e6-29364e5d178f admin admin] RBAC: Authorizing `identity:get_group(group_id=ec5cf3c1f9e8484bb75e7255952c843c)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:08.029920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4d886-0839-4cfd-93e6-29364e5d178f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:08.031490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 173/351] 10.222.0.16 () {56 vars in 1202 bytes} [Tue Aug 10 04:58:08 2021] GET /identity/v3/groups/ec5cf3c1f9e8484bb75e7255952c843c => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:08.037836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:08.046891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435d452-32d6-423b-98f8-b28a0c7d87ab admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:08.051130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:08.051736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:08.052025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:08.052303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:08.053104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] RBAC: Adding query filter params (group.id=ec5cf3c1f9e8484bb75e7255952c843c, role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=8beb590f33a341adaea78fed778aaecf) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:08.053412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:08.055236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae80fa8-59f2-4620-96ce-31c86b86dcf5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:08.060736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 179/352] 10.222.0.16 () {56 vars in 1398 bytes} [Tue Aug 10 04:58:08 2021] GET /identity/v3/role_assignments?group.id=ec5cf3c1f9e8484bb75e7255952c843c&scope.project.id=8beb590f33a341adaea78fed778aaecf&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 611 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:10.825105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a774cb-58ec-472c-bdb0-7c7e6ee680aa None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:10.825600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a774cb-58ec-472c-bdb0-7c7e6ee680aa None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:10.825600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a774cb-58ec-472c-bdb0-7c7e6ee680aa None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:10.827508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 174/353] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:10.840231 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:10.840754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:10.840832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:10.862841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:10.864548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:10.876965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 180/354] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:10.932724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a774cb-58ec-472c-bdb0-7c7e6ee680aa None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:10.945849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a774cb-58ec-472c-bdb0-7c7e6ee680aa None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:10.954319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:10.955171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:10.955450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:10.955723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:10.967042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:10.968873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:10.992285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:10.993484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 175/355] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:10.999891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.009610 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbbde03-66eb-444e-8964-32670de158e5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.018614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.019270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.019550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.019863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.020591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:11.020891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.022501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e044d75-7ce5-412e-bf19-b0313dd446ee admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.037225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 181/356] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:11.043154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.056735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a28bef-3423-4b2e-b7dc-e40b573c07d0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.067567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfb08c-8b61-4113-b8e1-63ccabb05fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.068274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfb08c-8b61-4113-b8e1-63ccabb05fca admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.068555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfb08c-8b61-4113-b8e1-63ccabb05fca admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.068822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfb08c-8b61-4113-b8e1-63ccabb05fca admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.069571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfb08c-8b61-4113-b8e1-63ccabb05fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.071590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfb08c-8b61-4113-b8e1-63ccabb05fca admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.172116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 176/357] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/users => generated 246 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:11.174839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555640a-c38b-4abc-8573-8bd17b17dce1 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.175134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555640a-c38b-4abc-8573-8bd17b17dce1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.175446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555640a-c38b-4abc-8573-8bd17b17dce1 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.177964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 182/358] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:11.184887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9ef0-05fa-481c-9c87-1b7c4cad107e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.185557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9ef0-05fa-481c-9c87-1b7c4cad107e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.186046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9ef0-05fa-481c-9c87-1b7c4cad107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.213095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-edfb9ef0-05fa-481c-9c87-1b7c4cad107e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:11.214817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-edfb9ef0-05fa-481c-9c87-1b7c4cad107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:11.231481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 177/359] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:11.257178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8307e8-d73f-4d0c-b1e4-6d3f62f4b0e7 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.257525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8307e8-d73f-4d0c-b1e4-6d3f62f4b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.257736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8307e8-d73f-4d0c-b1e4-6d3f62f4b0e7 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.260973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 183/360] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:11.266249 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.266543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.266868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.287320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8307e8-d73f-4d0c-b1e4-6d3f62f4b0e7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.290111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:11.291424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:11.304604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 178/361] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:11.306736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8307e8-d73f-4d0c-b1e4-6d3f62f4b0e7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.319933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.320753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.321530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.321530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.331028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.343576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.344234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bdf31f-3f8a-4fd2-8ca9-9cf9308436a2 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.345538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.356753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.357863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.357863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.358121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.369732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-24211329-f197-4302-a3ee-ad03bad3ced2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:11.371320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 184/362] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:11.372624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c4efd-71d0-48f3-8323-026ff4412fe8 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.372912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c4efd-71d0-48f3-8323-026ff4412fe8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.373187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c4efd-71d0-48f3-8323-026ff4412fe8 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.375205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 185/363] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:11.376404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.378297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.387069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.387344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.387615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.403231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:11.404851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 179/364] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:11.405712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.412384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:11.413337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:11.419504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d508e-9fa4-44f5-b0d4-e53bea8ed9ca admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.424107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 186/365] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:11.424719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.428808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.429475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.429775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.430030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.430803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:11.431110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.432129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:11.432129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:11.432129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:11.433155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.436102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa1ad-1efd-4e85-ada0-2e8c384d2475 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.441499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.442295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.442655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.442985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.443713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:11.444019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.445746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.458113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 180/366] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:11.460599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 187/367] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:11.464396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.467579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.475351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85fb0cf-742d-4e16-939c-944e1eb4d473 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.479012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bc9a7-cdf1-4cb5-b284-22e84610fdae admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.479866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.480536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.480824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.481105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.481820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.483791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.488015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.488930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.489384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.489839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.490740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.492856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.594712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 181/368] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/users => generated 248 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:11.595425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.613000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74e578-c03c-4387-9966-80afcd995b4c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.618128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.618993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.619282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.619563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.632147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.634046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.652310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:11.653909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 182/369] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:11.662087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.664625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 188/370] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:11.679603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad0f99-d1c6-477a-81f8-602afa802d37 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.687317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.688010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.688294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.688633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.689490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:11.689801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.691503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f3932-ddd5-489a-a5aa-43dcf5ec8629 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.713426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 183/371] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:11.719616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:11.737105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6204e-a008-4e6b-b8a4-735101230359 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:11.742857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaba9f-cec5-488d-b37b-6b678c0ce3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:11.743909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaba9f-cec5-488d-b37b-6b678c0ce3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:11.744411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaba9f-cec5-488d-b37b-6b678c0ce3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:11.744938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaba9f-cec5-488d-b37b-6b678c0ce3a6 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:11.745874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaba9f-cec5-488d-b37b-6b678c0ce3a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:11.754670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaba9f-cec5-488d-b37b-6b678c0ce3a6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:11.871105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 189/372] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:11 2021] POST /identity/v3/users => generated 249 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:12.191846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a4648-80be-4341-9ec4-e740f5269d68 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:12.192531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a4648-80be-4341-9ec4-e740f5269d68 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:12.192531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a4648-80be-4341-9ec4-e740f5269d68 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:12.194311 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 184/373] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:12.200618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:12.200904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:12.201178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:12.221043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:12.222238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:12.235383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 190/374] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:12.259368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a4648-80be-4341-9ec4-e740f5269d68 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:12.276557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a4648-80be-4341-9ec4-e740f5269d68 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:12.285694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:12.286374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:12.286679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:12.286952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:12.287721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:12.289329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:12.337335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.sql.core [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 10 04:58:12.337335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 10 04:58:12.337335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [parameters: {'id': '4c598b196d6b4a6a801ddd999937298d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 10 04:58:12.337335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73230) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 04:58:12.352070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 10 04:58:12.353788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 185/375] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 04:58:12 2021] POST /identity/v3/roles => generated 144 bytes in 95 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:12.360013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:12.374119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48f62e-ae27-4c13-8e22-ea59cb8396be None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:12.382296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44cb4e-2600-4cf1-953b-46b6bf44d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:12.388425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cb4e-2600-4cf1-953b-46b6bf44d906 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:12.388425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cb4e-2600-4cf1-953b-46b6bf44d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:12.388425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cb4e-2600-4cf1-953b-46b6bf44d906 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:12.399316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44cb4e-2600-4cf1-953b-46b6bf44d906 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:12.406750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-0f44cb4e-2600-4cf1-953b-46b6bf44d906 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 10 04:58:12.408194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 191/376] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:12.414708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:12.428232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d01b8d-0492-4d6d-81ce-0a02f452eabd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:12.437081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:12.437759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:12.438041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:12.438316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:12.439148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:12.439490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:12.441110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b7bc8-4f10-4d4e-9b49-d27e21ef46e7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:12.463498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 186/377] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:13.658222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c187b5-8c7d-449a-a211-b586e85fa23b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.658753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c187b5-8c7d-449a-a211-b586e85fa23b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.658862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c187b5-8c7d-449a-a211-b586e85fa23b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:13.661374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 192/378] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:13.667393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.667818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.667986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:13.690625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:13.691842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:13.701928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 187/379] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:13.740166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c187b5-8c7d-449a-a211-b586e85fa23b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:13.752284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c187b5-8c7d-449a-a211-b586e85fa23b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:13.762197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:13.763019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.763297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.763568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:13.775654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:13.787253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:13.788786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 193/380] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:13.794935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:13.804596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4936a1-6214-4501-86bb-1f8f6dbd086d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:13.809024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:13.809685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.809967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.810237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:13.811020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:13.811318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:13.812912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:13.826039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 188/381] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:13.832751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:13.842850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14cddd-06fd-4e92-9e59-fde5e432260c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:13.850453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:13.851302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.851583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.851851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:13.867836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:13.869739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:13.895597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:13.897127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 194/382] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:13.903171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:13.916309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c874112-6c61-4202-941d-14ba85d477ba admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:13.920684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:13.921347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.921625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.921901 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:13.922650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:13.922956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:13.924535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:13.944468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 189/383] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:13.950708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:13.963852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518f175-a939-4113-9368-248eb4a878c8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:13.975913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:13.976763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:13.977042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:13.977313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.099965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.102009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.121397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:14.122621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 195/384] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.128825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.148626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b7608-fd1e-4cd8-ba4d-fd65a914b452 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.152987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.153656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.153934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.154203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.155079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.155380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.156389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:14.156389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:14.156389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:14.157526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a7dfe-3b00-4928-8eec-d7eb62d32832 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.221113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 190/385] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.227891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.243671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fabec38-eb67-425c-8b96-1024e0c0d364 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.244577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0dab4-159c-40b1-91a1-7d95405236d4 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.244873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0dab4-159c-40b1-91a1-7d95405236d4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.245145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0dab4-159c-40b1-91a1-7d95405236d4 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.247270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 191/386] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:14.253650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.253938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.254647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.254855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.255360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.255643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.255912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.275629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.277773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.283401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:14.284661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:14.302941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 196/387] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:14.303224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 192/388] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:14.307594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.316518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f958f7-9007-460b-90de-c91e9ac41b20 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.326071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.326888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.327167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.327437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.338411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.344421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.368505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:14.369877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 197/389] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.376075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.385133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.392343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebcfd97-ea41-4327-a690-e502b529d9fe None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.398964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55e58e-f772-431b-8cb8-43348dbc4e23 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.403484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.404180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.404463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.404738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.405491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.405799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.407515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91ba61-7547-4ddd-8d7f-54c8333a1df3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.415346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cd89c-ac9a-4d34-83f9-922784cc364f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.416164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cd89c-ac9a-4d34-83f9-922784cc364f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.416446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cd89c-ac9a-4d34-83f9-922784cc364f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.416716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cd89c-ac9a-4d34-83f9-922784cc364f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.425791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 193/390] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.427376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d84f-2766-4105-8780-7e5ff274630b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.427671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d84f-2766-4105-8780-7e5ff274630b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.427949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d84f-2766-4105-8780-7e5ff274630b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.429766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 194/391] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:14.432391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cd89c-ac9a-4d34-83f9-922784cc364f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:14.434997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d84f-2766-4105-8780-7e5ff274630b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.440360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-520cd89c-ac9a-4d34-83f9-922784cc364f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:14.442307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 198/392] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:14.448163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.448384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d84f-2766-4105-8780-7e5ff274630b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.448862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.449393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.453236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.454219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.454625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.455006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.463239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.465519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.471012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:14.472405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:14.480260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 199/393] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:14.480558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:14.486597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.487845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 195/394] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.491024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1436b3-3b98-4867-8215-36fd942550f1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.494763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.495895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.496551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.496829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.497101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.497838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.498140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.499769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.508949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 200/395] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.512161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48f6f5-af94-4066-b678-d7891df0adb7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.516194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.520803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.521522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.522201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.522201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.522917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.523225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.524341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:14.524341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:14.524341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:14.525520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.532889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71570b-b302-4b62-b6c5-2d1d48aa5739 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.540738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.541538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.541814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.542088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.548819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 196/396] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.550474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.555066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.556967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.562779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779f01-40ef-4d09-b736-8f07ce93ce0f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.569341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.570553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.571073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.571547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.575708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:14.577273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 201/397] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.578101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.586719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:14.594716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd5541-ce52-4d3a-be31-896f1228da3c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.595932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:14.597473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 197/398] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.604417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.606257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.606960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.607225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.607496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.608323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=0b340b0c363a4c1ebaf9311b7349a6d2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.608627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.610474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.616701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 202/399] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/role_assignments?user.id=0b340b0c363a4c1ebaf9311b7349a6d2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.617559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.619754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a400f-fd7f-4c89-8a9d-f441eac0860f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.626181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.627215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704c46-19da-4968-81fc-ef9ac68c60a6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.627596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.628274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.628883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.630217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.630945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.631930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.632598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.632885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.633155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.633888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.634189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.634290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4063bd9e-bc22-4818-898c-a42467d39715 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.635799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.648886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 198/401] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.649227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 203/401] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.654537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa914dc-9257-4605-8b9f-0e4e494ff71b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.654848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa914dc-9257-4605-8b9f-0e4e494ff71b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.655125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa914dc-9257-4605-8b9f-0e4e494ff71b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.656088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.657074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 199/402] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:14.659497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa914dc-9257-4605-8b9f-0e4e494ff71b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.668657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91760212-ca80-49a7-83e7-7eb6df44db5b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.674021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa914dc-9257-4605-8b9f-0e4e494ff71b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.675339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.676695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.677286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.677896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.679026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.680044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.680394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.680736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.691456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.691994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.693780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.694510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.711169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-fa73ace0-70fb-407e-9faf-8e3516bc3f74 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 04:58:14.712914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 200/403] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/users/glance => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.714262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.714729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:14.716119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 204/404] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:14.721207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.721207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.722752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.734137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247b399-c220-4ca4-8554-3e00d6dbbb0e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.739995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.741094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.741534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.741647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:14.742142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.743103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:14.743409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.743869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.745312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:14.745312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:14.745312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:14.747148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.751973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 201/405] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:14.753016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.763659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d974a62-8a1f-4643-a7fe-8aa7decc100b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.768743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.769472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.770362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.770733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.771526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.771888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.773651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.791314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 202/406] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.791856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 205/407] 10.222.0.16 () {56 vars in 1159 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.795262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.802211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.808666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088caa29-4de2-4566-8b43-b54fa3eacf02 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.814076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6d903-34ac-462b-af95-d6fe964b0401 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.814782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.815734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.816079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.816420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.820398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.821427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.821905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.822353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.830026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:14.831180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.833467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.837318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:14.838530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 203/408] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:14.839325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.850406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 04:58:14.850564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e84b2-df56-4a3b-a022-38f8150ca28a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.852283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 206/409] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:14.853145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.860136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.860782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.861065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.861331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.863829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18df792-89fd-4764-af41-821dcd5e7022 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.868428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.869248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.869672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.869828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.870235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.871180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.871495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.871782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.873514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.881199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 204/410] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:14.883063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 207/411] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.887081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.888068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.898087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ce489-f38c-4ca9-9490-7e925e3c2347 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.901557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b9bc5-f178-4044-864f-a83b0e6764d9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.902651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.903325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.903604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.903878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.904814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:14.905140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.907219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.908256 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.909324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.909811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.910204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.921483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.923485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.926283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 205/412] 10.222.0.16 () {56 vars in 1159 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:14.930697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.943233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe8497-688f-421f-90cd-fa70283f3ce7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.945906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:14.947534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 208/413] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.948184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.948697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.951087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.951502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.951938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.963333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10b87a-c443-46cc-a55c-03707dbe605d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:14.965252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.967665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.968290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:14.969087 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:14.969514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:14.969935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:14.978872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:14.980990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:14.986618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:14.988235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 206/414] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:14.989719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.991803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 209/415] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:14.998011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:14.999942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718487b2-135a-4224-80e3-76610ff628c1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.004754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.005597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.005979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.006309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.007169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.007646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.008575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3218-252d-4026-b815-1c9f3174450f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.009591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.013322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.014258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.014716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.015146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.022865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 207/416] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.028053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.028950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.030495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.039631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cdd58-f845-46fc-b75e-1a066d2544a2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.044481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.045277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.045650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.046054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.046955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.047356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.049201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.049583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:15.050962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 210/417] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.056815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.062851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 208/418] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.063943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.068242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df45dbc-5add-47f4-a146-fbd181dab392 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.074565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.075405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.075683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.075949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.077935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be82c76-60c2-482c-a68f-d9753a4f2b58 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.083094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.083586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.084237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.085025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.085490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.085814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.086855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.087353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.089197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.100003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:15.101211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 211/419] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.107097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.107236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 209/420] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.111522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.123543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6963458-28db-473d-befd-a8b3caaf6a77 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.125173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb685-6b39-4c6a-9d83-496f03298ac4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.128265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.129198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.129579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.129974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.131350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.132463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.133420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.133893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.134934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.135382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.137849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.138219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.140378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.153979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 210/421] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.159765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 04:58:15.159765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 212/422] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/users/neutron => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.159765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.161284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.170349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91715c5-866a-44ea-a0e0-974b4a68bb0a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.173994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c66ed2-d4f1-442b-8857-986b2af51421 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.174908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.175679 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.175960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.176818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.180705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.181572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.182047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.182515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.183836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=5350c5f195db471189281bf10b9cd9ee) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.184304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.184630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.186351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.187057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.193732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 211/423] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/role_assignments?user.id=5350c5f195db471189281bf10b9cd9ee&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.198852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.199832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:15.201465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 213/424] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.208463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.220373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b453b-4bac-422b-97dc-7e623a5440cd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.225825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c80ff-d478-4a9d-ba39-c5bfd75aaf9c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.228894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.229566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.230133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.230616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.231420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.232290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.233914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:15.233914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:15.233914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:15.235606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.239080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.239825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.240105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.240379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.241280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.241590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.246646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.281201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 214/425] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:15.289262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.307740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ec48-428f-4e2b-aae3-cb8120a8b620 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.317991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.318746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.319027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.319300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.320293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=c0521977aa404994bcb8e6ce0dea4bd3) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.320607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.327856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e19478-708d-4719-8508-c12c3b13a820 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.337405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 215/426] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/role_assignments?user.id=c0521977aa404994bcb8e6ce0dea4bd3&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:15.438905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96899bc-2d91-495c-a78e-ab9232e61eb5 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.439200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96899bc-2d91-495c-a78e-ab9232e61eb5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.439386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96899bc-2d91-495c-a78e-ab9232e61eb5 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.439787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 212/427] 10.222.0.16 () {56 vars in 1161 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.441426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 216/428] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:15.446989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.448580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.448950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.449255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.460482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc12f6-bb40-47e5-bb7d-fe3af53e2d25 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.466505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.467621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.468112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.468560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.470957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:15.472295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:15.478779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.480908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.486797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 217/429] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:15.492071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 213/430] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:15.499931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.517206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.518235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8867d-5f4f-4126-926d-b14a0816bad7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.523140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.524100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.524451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.524978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.538858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8439da-d305-47b6-9856-2821a65c0578 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.540017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.541998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.544688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.546100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.546538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.546977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.570545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:15.570880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.572372 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 218/431] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.572876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.583635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.592303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:15.593946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 214/432] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.595129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd6373-e29e-44be-aa9e-49e908664929 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.600392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.600842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.601056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.601343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.601619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.602354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.602689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.604324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.616415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860982-dc35-4ea5-afdc-19d4b1a13370 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.623312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 219/433] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.625253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.625915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.626247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.626529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.627507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.627818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.629812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.631298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.648123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd84ae-e562-47b4-8f3e-1f059111d5d8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.658015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 215/434] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:15.658690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.659589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.659874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.660151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.663460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.679154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301845a-11f5-4819-80cb-e02a7702fdd0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.680534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.683516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.689383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7ebe3-a840-4857-bddc-4939c61d028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.691271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7ebe3-a840-4857-bddc-4939c61d028a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.691564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7ebe3-a840-4857-bddc-4939c61d028a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.693135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7ebe3-a840-4857-bddc-4939c61d028a admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.693868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7ebe3-a840-4857-bddc-4939c61d028a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.697481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7ebe3-a840-4857-bddc-4939c61d028a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.711783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:15.715310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 220/435] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:15.719296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.730484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d037b-b148-42d9-861e-18698bfa72b8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.735363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.736077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.736413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.736692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.737524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.737840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.740007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.753216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 221/436] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:15.760080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:15.774237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbe2ec-1d3a-4dc6-8884-0171adf456bf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:15.779069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:15.779946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:15.780368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:15.780779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:15.781800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=4d558aa3bcd84a2f8407c2e566da213b) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:15.782260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:15.784358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954011-2c72-4686-81ac-a13a0df2fd5e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:15.790891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 222/437] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:15 2021] GET /identity/v3/role_assignments?user.id=4d558aa3bcd84a2f8407c2e566da213b&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:15.798647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 216/438] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:15 2021] POST /identity/v3/users => generated 247 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:17.160756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47a6a-76ad-45b8-8b42-b59dc6aa72d5 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.161315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47a6a-76ad-45b8-8b42-b59dc6aa72d5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.161315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a47a6a-76ad-45b8-8b42-b59dc6aa72d5 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.163408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 223/439] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:17.175148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502965f-e381-4085-9651-80050d3ff39e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.175643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502965f-e381-4085-9651-80050d3ff39e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.175752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502965f-e381-4085-9651-80050d3ff39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.197604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b502965f-e381-4085-9651-80050d3ff39e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:17.198985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b502965f-e381-4085-9651-80050d3ff39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:17.213140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 217/440] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:17.252570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47a6a-76ad-45b8-8b42-b59dc6aa72d5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.272257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a47a6a-76ad-45b8-8b42-b59dc6aa72d5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.276958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.277773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.278056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.278333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.299484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:17.307031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:17.308333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 224/441] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:17.314803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502965f-e381-4085-9651-80050d3ff39e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.326113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502965f-e381-4085-9651-80050d3ff39e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.344114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.345013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.345436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.345845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.346793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:17.347256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.349500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.367164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 218/442] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:17.373487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.391595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732645b9-dc47-4c6f-a86c-e2ccb53afd99 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.399086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.399924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.400206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.400477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.421926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.423767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.448796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:17.450346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 225/443] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:17.456365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.474613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca94863-1208-445c-aa8a-7c60a25836f3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.488137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.489040 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.489461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.489869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.490754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:17.491213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.492942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.506299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 219/444] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:17.512543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.536435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1c3db-be9a-46f5-a932-8d98f357e8ca admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.547775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.548573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.548906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.549187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.563731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.565879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.585575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:17.587128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 226/445] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:17.593023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.607707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6aba9-9967-45a4-916c-c82f4044de08 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.623727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.624583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.625006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.625419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.626419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:17.626889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.628889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.647643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 220/446] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:17.653798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.663843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743730c-6845-4e79-9925-0f46d94bb138 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.674415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.675483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.675905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.676841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.693943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.696146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.724810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:17.726293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 227/447] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:17.732493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.747346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b78bc5-c9ee-481b-a42b-359525494790 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.752266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.753089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.753510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.753924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.754967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:17.755414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.757153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.770806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 221/448] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:17.777456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.788216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea502fd5-8063-46cb-8a61-d276fb8641b4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.797919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.799011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.799437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.799876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.808726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.810986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.831552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-87d392a4-144c-4fbb-a30e-fa1efdae4656 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:17.833031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 228/449] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:17.839615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.850905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104c732-2cc2-4006-917e-e266e44603ab admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.855685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.856354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.856687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.856965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.857755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:17.858116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.860142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.868216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc82b4-25ae-4e9b-91cb-56149cc7147c None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.868506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc82b4-25ae-4e9b-91cb-56149cc7147c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.868817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc82b4-25ae-4e9b-91cb-56149cc7147c None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.871136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 229/450] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:17.878045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074140-1dab-4162-b8cc-8dcadc0e3db5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.878378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074140-1dab-4162-b8cc-8dcadc0e3db5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.878693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074140-1dab-4162-b8cc-8dcadc0e3db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.882510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 222/451] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:17.898704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.907629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-54074140-1dab-4162-b8cc-8dcadc0e3db5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:17.908834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-54074140-1dab-4162-b8cc-8dcadc0e3db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:17.912501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37515722-35e7-423d-a767-af8dedebe293 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:17.920565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:17.922839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.923540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.923824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/0b340b0c363a4c1ebaf9311b7349a6d2/roles/661315ffc5a040a996976997e234726f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.929013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 230/452] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:17.941768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=0b340b0c363a4c1ebaf9311b7349a6d2, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:17.945477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b0e4-9c33-42ce-83ba-fe845740cbc2 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.945769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b0e4-9c33-42ce-83ba-fe845740cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.946047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51b0e4-9c33-42ce-83ba-fe845740cbc2 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.947826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 231/453] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:17.948709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:17.953790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:17.954075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:17.954405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:17.972191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:17.974625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:17.981674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 232/454] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:17.986706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:17.996603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf8616-4033-471c-954e-14f4d0ffb8ea None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.001413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.002441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.003006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.003425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.014655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:18.021435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:18.022746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 233/455] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.023355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.033244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad137bae-68a2-40ae-9618-1a125e9f3a3e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.040177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 223/456] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:17 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/0b340b0c363a4c1ebaf9311b7349a6d2/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:18.041403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.147489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.148672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.149132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.149576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.162185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:18.174131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:18.175931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 234/457] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.184118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7b1b6-93da-40e6-b855-d86e17ef751c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.188931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.189627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.189910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.190185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.191067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.191377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.192915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.193141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.202646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 224/458] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.210620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b551b3-19be-47d1-a6d5-bb44fc7a4345 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.210795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.218414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.219126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.219500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.219775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.220540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.220891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.221613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56004df-5836-4699-b2e9-3dd45f407991 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.225485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.228667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.229489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.229872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.230152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.239885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 235/459] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:18.243011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.245084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.246761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.257791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a995137-156f-49ab-99e0-c36f54759c48 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.264215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.265084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.265377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.265626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.265724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:18.267348 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 225/460] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.274235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.277887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.279794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.284820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804b26e-795a-4c44-aeac-63afa8f6c6d0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.293903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.296016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.296301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.296573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.297353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.297707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.299396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19b555-8867-46cd-a93d-6094bdf07093 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.303246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:18.304969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 236/461] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.311061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.313777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 226/462] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:18.315345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc03eaf-f930-4534-9e0b-eadc194f2a8b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.315641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc03eaf-f930-4534-9e0b-eadc194f2a8b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.315919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc03eaf-f930-4534-9e0b-eadc194f2a8b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.317660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 227/463] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:18.324905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc03eaf-f930-4534-9e0b-eadc194f2a8b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.329332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc202c4-cdd2-4479-9a9f-bf4d974cf60d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.339293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.340574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.340910 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.341188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.342253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.342564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.344251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e54ff9-68c8-42b7-82d9-17946cc31a5f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.345634 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc03eaf-f930-4534-9e0b-eadc194f2a8b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.351467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.352953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.353437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.353930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.358155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 237/464] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:18.362700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.362700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.362700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.368315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.371580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.383308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:18.384731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:18.387062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 04:58:18.388563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 228/465] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/users/glance => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:18.393591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.399951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dddf5c-0c75-463b-b59c-96f34e14e238 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.400299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 238/466] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:18.401374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.409950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.411427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.412716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.413834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.422409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db4c75-01d2-473f-9fd6-8e4faf8af259 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.428625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.430357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.430677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.431750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.432227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.432918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.434663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.435230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.437366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.448505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 04:58:18.449730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 229/467] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/users/cinder => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.450506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.462096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 239/468] 10.222.0.16 () {56 vars in 1159 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.464832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.469905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493c3d6-a0d8-42ac-a4f2-b02d658e6541 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.474537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.475359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.475622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.475891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.483110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15e658-6060-490b-a063-63e0f7a45858 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.487417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:18.488335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.489773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.490269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.490856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.491902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.492474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.494673 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.495326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:18.496685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 230/469] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.498635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.516202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b49b-85e1-456e-982c-3bf9eeceb5b6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.525453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 240/470] 10.222.0.16 () {56 vars in 1159 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.530295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.533240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.534049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.534323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.534607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.547546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f27b5d-619d-4f3e-be2b-47851cc9b94e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.550021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.552416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.554443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.555677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.556177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.556666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.557603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.558110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.560329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.569836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:18.570691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 241/471] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.571758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.575170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 231/472] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.577326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.584065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263d312-5cb8-444f-a246-bd336a67aa2b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.587517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4803c9d8-b59a-4a35-86ad-d69725ea5ef2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.589908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.591197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.591769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.592143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.592488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.592888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.593214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.593485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.605358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.606235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.607232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.608732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.624250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:18.625524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 232/473] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.626415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.627872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:18.629261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 242/474] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.637863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.639687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a91c38-e640-4b52-9c09-bbfea23574e0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.644629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.645395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.645780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.646152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.646967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.647213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9dba6-bd73-43f4-811a-436c4982ec67 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.647436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.649176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.652261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.652968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.653319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.653659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.654430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.654842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.656936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.667481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 233/475] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.668345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.670261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 243/476] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.676458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.679985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c033a61-198f-450a-845e-457881a819ae admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.684435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.685124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.685471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.685747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.686457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.686790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.688263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff331c69-b2a2-4233-8827-71d223554a71 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.688383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.694235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.695696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.696093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.696466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.700214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 234/477] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.700847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.709299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.712648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.713741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1333d-27ee-4008-8cf5-2afe8e344d8f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.718161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.718963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.719333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.719506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.727592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.728890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:18.729580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.730531 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 244/478] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.731262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.743913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3b65f-dbf8-4339-8e3d-f2b7e3286168 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.748170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 04:58:18.748812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.749351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 235/479] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.749769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.750171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.755052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.758869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.763830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7a034-2f06-4e47-836d-11736c78fd39 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.768434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.769102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.769419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.769606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.770710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.770999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.771309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.772813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.773145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.786492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:18.787940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 245/480] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:18.788676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.792379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 236/481] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.799132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.806734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f7909-f016-4227-9355-212e6f08148d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.809658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f440a-cdc2-4291-95dd-30c84e68dc33 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.812772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.813841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.814333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.814798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.815056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.815873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.816134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.816354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.817241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.817517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.818211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:18.818611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.819970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.820774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.835378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 237/482] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.840751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.845405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 246/483] 10.222.0.16 () {56 vars in 1161 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:18.846336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.853614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbecee-6438-4621-afed-0ba04baa3bc9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.856270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a5f35-cf02-4a09-a10e-592cc6b2cda0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:18.858798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.859867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.860115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.860382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/5350c5f195db471189281bf10b9cd9ee/roles/661315ffc5a040a996976997e234726f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.860721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fdff5-fb92-4730-ab07-c92b38b0df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:18.861586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fdff5-fb92-4730-ab07-c92b38b0df02 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.861864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fdff5-fb92-4730-ab07-c92b38b0df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.862133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fdff5-fb92-4730-ab07-c92b38b0df02 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/c0521977aa404994bcb8e6ce0dea4bd3/roles/661315ffc5a040a996976997e234726f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.874773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=5350c5f195db471189281bf10b9cd9ee, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.876536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fdff5-fb92-4730-ab07-c92b38b0df02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=c0521977aa404994bcb8e6ce0dea4bd3, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:18.877453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.880052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fdff5-fb92-4730-ab07-c92b38b0df02 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:18.954695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 238/484] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:18 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/5350c5f195db471189281bf10b9cd9ee/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:18.955810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:18.974196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 247/485] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:18 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/c0521977aa404994bcb8e6ce0dea4bd3/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:18.974196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fb90-6bcd-4a3e-848a-edb971e8d6ef None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.974196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fb90-6bcd-4a3e-848a-edb971e8d6ef None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.976319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9fb90-6bcd-4a3e-848a-edb971e8d6ef None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:18.976319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 248/486] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:18.983227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:18.983631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:18.984005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.003816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:19.006008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:19.036578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a169a8-f5b6-43fb-a31b-bf6eb6c0aefa admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.117545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 249/487] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:19.159543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.161159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.161547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.161923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.175353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.177454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.186153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.196422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0dceeb-91c4-4067-a11d-03e9bf96a846 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.202250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:19.204092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 239/488] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:19.204198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.213542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.213542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.213542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.213812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.220670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:19.223936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c17fb4-4755-4c4e-9285-f1f8ef82ffcd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.228741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.229654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.229862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:19.230319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.230875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.231168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 250/489] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:19.235301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.235770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.237622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.246063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.251123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 240/490] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:19.257030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.261240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38942-1920-4d04-ac95-69ce54fe7cfb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.265197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.266146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.266669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.267144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.267247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802452e-54b4-4133-a38f-0e1f6c3410fb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.268387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.269024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.271597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.272646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.273657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.274006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.274344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.281731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.283342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 251/491] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:19.286262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.290237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.299198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:19.300874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce23bf7-5f88-46d4-a3dc-a58000d7c131 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.306230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.306363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 241/492] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:19.307373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.307559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.308108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.308658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.318283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b40db6-5371-4a76-8bcf-52607b07b4b1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.322024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.323959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.324609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.324922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.325324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.325676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.326670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.327097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.330019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.346448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:19.348747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 242/494] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:19.348985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 252/494] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:19.352484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.355545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.362623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e568bcf-7bef-4d50-9bff-57b864dc34bd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.368004 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0536b11-9995-4125-964d-f4ee7b59427a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.368678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.369608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.369885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.370205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/4d558aa3bcd84a2f8407c2e566da213b/roles/661315ffc5a040a996976997e234726f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.374720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.375626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.376109 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.376600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.377532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.378049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.380545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.386648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=4d558aa3bcd84a2f8407c2e566da213b, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.389812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.395646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 253/495] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:19.406686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.413030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57e9da-2431-49c6-a4cb-359bee104041 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.417967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.418811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.419093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.419364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.428085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.430230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.445245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 04:58:19.446567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 254/496] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:19.452893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.463364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bda82-0901-4422-ae6b-c99a639e93f8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.468074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.468702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.468983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.469309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.470134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.470488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.472550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.490986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 243/497] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:19 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/4d558aa3bcd84a2f8407c2e566da213b/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 04:58:19.514615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 255/498] 10.222.0.16 () {56 vars in 1157 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:19.523823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.608724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf79b1d-35f1-4f79-bbd4-8fedc791add0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.614879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.615548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.615826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.616100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.631617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.633411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.648659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 244/499] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:19.655521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.666137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6fcabb-9416-4372-88c3-e9bfd8b52a41 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.674442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.675286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.675569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.675842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.692731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.694605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.713617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:19.717483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 256/500] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:19.723618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.732612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9744eb63-89f2-443d-9873-1621a5d059ac admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.738013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.739313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.739693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.740062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.740893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.741298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.743024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.754603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 245/501] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:19.763712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.774215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea402a-8191-4249-82e5-59f2a1fe9026 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.780024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.780869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.781199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.781472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.793515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.795567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.810395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:19.816773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 257/502] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:19.818005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.831651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b72226-b178-4818-b148-a0d0f3e581d1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.843194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.843866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.844152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.844423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.845212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.845521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.847420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd23d0-be01-484e-a324-d2490a4efe1c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.866548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 246/503] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:19.873120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:19.884102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1961b4-76af-4d5f-bf13-c6b804bf8c60 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:19.890814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:19.891472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:19.891756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:19.892033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:19.892861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=92f6a41de2f0409db2d99a8c3ee5b4a2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:19.893170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:19.895575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6277dbfa-b5df-4b13-8d70-d743a14ec5d0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:19.906940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 258/504] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:19 2021] GET /identity/v3/role_assignments?user.id=92f6a41de2f0409db2d99a8c3ee5b4a2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:20.462484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce67a-783a-4b30-94c4-d0b5ab8702e3 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.463043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce67a-783a-4b30-94c4-d0b5ab8702e3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.463043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ce67a-783a-4b30-94c4-d0b5ab8702e3 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.465115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 247/505] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:20.470945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.471387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.471565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.495655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:20.496864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:20.505571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 259/506] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:20.557456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ce67a-783a-4b30-94c4-d0b5ab8702e3 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.574819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ce67a-783a-4b30-94c4-d0b5ab8702e3 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.581796 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.582679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.582963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.583233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.601371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:20.612107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:20.613337 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 248/507] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:20.620508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.630361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434ef48-2ed6-42ef-83e3-104e577c138f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.638903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.639585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.639868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.640145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.640896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:20.641207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:20.642915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:20.654195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 260/508] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:20.660778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.675490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319f618-6a44-4a8f-af7e-608f8bdf0bc4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.684065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.684858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.685142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.685421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.702184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:20.704072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:20.724715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:20.725856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 249/509] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:20.733443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.755716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbc76-b23a-4e7b-9d9f-e33a142bfa91 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.768203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.768870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.769150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.769423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.770731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:20.771039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:20.772655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:20.792578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 261/510] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:20.798872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.811334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b16c9-118a-4edb-bf14-7c5e3fb8ecbc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.820090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.820884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.821162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.821434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.831399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:20.834001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:20.850503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:20.852022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 250/511] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:20.858289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.871686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6afa95-49f3-48ce-bcc1-2318ddc3e5d8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.881388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.882098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.882380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.882682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.883557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:20.883867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:20.885784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:20.910064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 262/512] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:20.916646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.931895 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbe717-2a42-4c5c-ab2a-7db7c643ed6d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:20.939727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:20.940377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:20.940658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:20.940930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:20.954140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:20.955935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:20.972440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 251/513] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:20.981040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:20.995808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df263011-f8b2-4890-a2d0-4a01c223f287 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.005222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.006018 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.006297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.006590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.022282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.024163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.044955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:21.046459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 263/514] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:21.053042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.062016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d203a-57fe-4b7e-9936-4c1624fb0228 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.066798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.067483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.067773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.068048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.068759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:21.069066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.070686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.083234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 252/515] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:21.091912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.107594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00085f-0026-430b-938a-9f65bbe06ac5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.113236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.114722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.115055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.115330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.125506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.127651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.143081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:21.144339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 264/516] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:21.150772 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.164162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007bd82-1e47-4957-9e26-1d6d222d2af6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.169464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.170178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.170465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.170808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.171598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:21.171906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.174005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8f7e3-eca9-43d5-833b-86ad8f12bd78 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.189483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 253/517] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:21.196194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.208129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9ae2c-41a0-4e85-b7ab-3f18b2c3d643 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.219007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.219662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.221968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.221968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.221968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=0b340b0c363a4c1ebaf9311b7349a6d2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:21.221968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.224021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10826b5e-5689-4ea6-b74f-ac4e21f6a1bf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.235505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 265/518] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/role_assignments?user.id=0b340b0c363a4c1ebaf9311b7349a6d2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:21.630223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49164122-247f-4932-8947-4c3d87c19313 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.630747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49164122-247f-4932-8947-4c3d87c19313 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.630849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49164122-247f-4932-8947-4c3d87c19313 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.632916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 254/519] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:21.638952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.639391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.639702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.658169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:21.659461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:21.670173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 266/520] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:21.695059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49164122-247f-4932-8947-4c3d87c19313 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.708374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49164122-247f-4932-8947-4c3d87c19313 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.713022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.713790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.714101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.714347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.725947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:21.732904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:21.734557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 255/521] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:21.741351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.750736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df8246-aaac-4d64-bca7-c8ee74d2447d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.755836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.756499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.756779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.757054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.757795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:21.758130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.759771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.769176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 267/522] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:21.775392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.786559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1f1a7-7794-49b5-b625-77cf9b9ca7df admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.791164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.791941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.792223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.792505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.803114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.804953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.822269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:21.823956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 256/523] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:21.830014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.841191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f616edd-3615-41bd-8f93-31680f200d7b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.845810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.846471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.846861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.847139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.847857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:21.848739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.850267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.863272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 268/524] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:21.871657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.883676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851fc30-eec6-4d76-915a-b84c611e5331 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.888195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.888984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.889265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.889537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.897262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.899468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.915144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 04:58:21.916729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 257/525] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:21.924933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.935750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ebc54-82af-4d7e-a54d-4c7445342e64 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.940740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.941482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.942314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.942603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:21.943525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:21.943834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:21.945805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d235c4-be95-449b-b960-949a41952b31 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:21.967371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 269/526] 10.222.0.16 () {56 vars in 1159 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:21.973675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:21.984324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8a59e-71dd-4b5e-8e14-0d30244f37a9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:21.989941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:21.990643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:21.990928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:21.991202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.000637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.002544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.012694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd05c5-b7ea-4d75-b5fa-5a9e89525d88 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.012981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd05c5-b7ea-4d75-b5fa-5a9e89525d88 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.013253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd05c5-b7ea-4d75-b5fa-5a9e89525d88 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.015522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 270/527] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:22.021017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 258/528] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:22.025165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9055-55fe-43c1-8489-1024ba8a8308 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.025165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9055-55fe-43c1-8489-1024ba8a8308 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.025165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369c9055-55fe-43c1-8489-1024ba8a8308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.028082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.037628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086629f-010f-4906-8160-33a1ee9e590d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.044300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.045393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.045823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-369c9055-55fe-43c1-8489-1024ba8a8308 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:22.046047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.046494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.047253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-369c9055-55fe-43c1-8489-1024ba8a8308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:22.055888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 271/529] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:22.059922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.062070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.063953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fa20-a02f-4253-91fd-ae9d16210d7f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.064318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fa20-a02f-4253-91fd-ae9d16210d7f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.064658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210fa20-a02f-4253-91fd-ae9d16210d7f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.066847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 272/530] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:22 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:22.072758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.073128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.073458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.092631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:22.094248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 259/531] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.095131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.105083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a08a67-25bb-4e04-b7aa-f59f9f6ad738 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.109699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:22.110989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:22.111417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.112545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.113047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.113519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.119960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 273/532] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:22.120900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.127347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:22.130080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95855d-fd14-49ec-bb92-805bb1530178 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.134820 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.135454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.135735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.136052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.136473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:22.136761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.137116 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.138567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 260/533] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.142827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.145972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.155033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 274/534] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.156138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.161624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9019c8f-34e5-4f81-b7bb-69794edb5421 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.166493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.167285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc43439-3b42-4f32-a894-213d43e3ca40 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.167403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.167750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.168121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.168977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.169381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.171378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.173154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.174168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.174451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.174761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.182217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 261/535] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:22.188180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.188302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:22.193712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:22.194919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 275/536] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.195728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.199647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bee586-83d0-4c9f-b10d-cb4db254bc9c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.204972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.205684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70cf26e-f5c1-4edd-a11a-7e36d7609c41 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.206236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.206797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.207857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.211311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.216119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.216119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.216119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.217253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.219529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.223347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.225189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.234401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:22.235906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 262/537] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.237003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.242995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:22.244524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 276/538] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.250161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.253951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2001f-a5d9-48f3-a5d3-e65c168bda39 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.255587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27450090-cb6b-44fe-80d9-2632c3c0c35c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.259638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.260023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.260717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.260998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.261267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.261446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.261941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.262176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.262481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.273489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.273489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.273489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.273737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.273812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.275465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 263/539] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.276566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.277307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 277/540] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.287388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.287652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee478d3-5389-4278-85d5-435fc1fb5894 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.292562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.293456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.293941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.294446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.295405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.295926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.297726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.297834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e47075-a0a7-4d1d-822f-4e25efb71a33 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.302956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.303728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.304004 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.304274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.312268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 264/541] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.317533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.317670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.319045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.332716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0d279-002f-4a4d-aba9-5082b648d02b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.335973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:22.337679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.338167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 278/542] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.338335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.338684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.338962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.339773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.339880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=c0521977aa404994bcb8e6ce0dea4bd3) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.340090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.342061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.350095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 265/543] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/role_assignments?user.id=c0521977aa404994bcb8e6ce0dea4bd3&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.350986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.351811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c6a734-d163-4111-ba02-70b0a330f018 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.356985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.358168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.358746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.359298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.361053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11213b-2037-4e02-95ac-7792b1feda82 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.366758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.367448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.367728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.367991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.368725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.369031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.370706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.372817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.375199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.384863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 266/544] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.391434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.406637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 10 04:58:22.406829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158edc1-372f-4435-a8ef-a1d6ee25e161 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.406935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 279/545] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/users/glance => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.412254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.427385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.428208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.428486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.428773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.429913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53936891-55ff-4ff7-945e-8d002c03e954 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.449123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.451815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.452805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.453728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.454067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.454344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.457091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.457521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.460778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.482530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 10 04:58:22.486725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 267/546] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/users/neutron => generated 85 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:22.493527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.501143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 280/547] 10.222.0.16 () {56 vars in 1159 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.508171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.519604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553542a-2117-408a-aaa5-9ead71c99499 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.524399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5be982-d86b-47ae-a9fd-0993a9a88b91 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.530969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f18f2-285b-4c41-829b-699f70c7f9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.531639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f18f2-285b-4c41-829b-699f70c7f9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.531925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f18f2-285b-4c41-829b-699f70c7f9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.532199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f18f2-285b-4c41-829b-699f70c7f9f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.540162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.540776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.541058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.541328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.542204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.542486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.544381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860aeaee-0cf4-4f71-8ddf-a20957410c7b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.550102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f18f2-285b-4c41-829b-699f70c7f9f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.552592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f18f2-285b-4c41-829b-699f70c7f9f7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.563447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 281/548] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:58:22.564933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4edae4-807e-4b82-9016-4157361fea8e None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.565232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4edae4-807e-4b82-9016-4157361fea8e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.565511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4edae4-807e-4b82-9016-4157361fea8e None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.567844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 282/549] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:22.570992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 268/550] 10.222.0.16 () {56 vars in 1161 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.572123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4edae4-807e-4b82-9016-4157361fea8e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.574615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.575132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.575615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.591940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4edae4-807e-4b82-9016-4157361fea8e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.594737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:22.596042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:22.596769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.597556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.597840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.598783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.606975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 269/551] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:22.607909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.613274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.616714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.617957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94a622-f6ee-4855-9b6a-cacce87608bb None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.622688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.623556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.623941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.624355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.634502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.636479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.638656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:22.640011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 283/552] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:22.640648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.648283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 270/553] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:22.649189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.655381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee3ec9-6876-4a50-abbc-9be4c869cb66 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.659376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c3cea-48a0-4911-aa05-7f4b66be253e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.661526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.662480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.662976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.663394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.665601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.666368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.666782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.667159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.667996 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.668397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.670079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.674291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:22.681174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:22.682524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 284/554] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.683190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 271/555] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.683305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.689538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.699848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53777310-1c79-4dc3-a00a-ca74717e5309 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.700899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd6198-00eb-4069-97d0-ef93f75f3dad admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.704698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.705485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.705816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.706091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.706375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.707327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.707748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.708330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.717463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.718103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.719738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.720079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.734203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:22.735909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 272/556] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.736780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.737270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:22.743425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 285/557] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.747399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.752908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a38a05-fd93-480e-a181-2bda36f49e21 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.757550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.758323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.758711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77c53b-b730-417b-a212-515d0bc7418f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.758825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.759200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.760089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.760454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.762127 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.764063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.764893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.765326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.765741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.766697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.767144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.769140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.772016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 273/558] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.772915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.782290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261f0ae-03f9-49af-96df-15e94a381f11 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.783553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 286/559] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.790276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.793321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.794140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.794521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.794930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.795817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.796336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.798019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.801556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2d43b-8fb2-4576-b247-e4483b6e5c71 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.806277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.807277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.807699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.808097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.812195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 274/560] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.813208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.819786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.821808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.824087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a37-3b71-4db3-b6b3-1f62db907608 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.828736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.829487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.829870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.830240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.831275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=5350c5f195db471189281bf10b9cd9ee) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.831682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.834243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.840637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 275/561] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/role_assignments?user.id=5350c5f195db471189281bf10b9cd9ee&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.841537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.842907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:22.844583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 287/562] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.850816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.851640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627ff347-05a7-4199-8f0e-039fe253a851 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.856278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.857178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.857630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.857943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.864628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4dbc3-fa93-466e-902f-2e462d27ae91 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.866245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.868442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.870925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.872276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.872703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.873234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.874102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.874634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.876810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.883369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:22.884916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 276/563] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:22.891048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.891685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 288/564] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:22.898423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.903929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff17e18-58ec-4cc2-93bd-5ae7b62ddb91 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.908207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6b35c-0806-4a97-a194-a255a68ead31 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.910085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.911109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.911609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.912123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.913258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.913663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.913924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.914721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.915126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.915504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.916629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.924129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.926798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.936409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 277/565] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:22.945366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 04:58:22.946605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 289/566] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/users/swift => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:22.947195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.953198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:22.969217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c3913-e691-4676-98da-878da7d760ee admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.970771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473adfad-d773-4a0c-b0c9-26ee211b6e85 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:22.978997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.979856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:22.980647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.981434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:22.981827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.982225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.982628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:22.983604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=4d558aa3bcd84a2f8407c2e566da213b) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.984008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:22.985176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.985499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:22.987594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:22.988121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:22.990654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:23.004552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 278/567] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/role_assignments?user.id=4d558aa3bcd84a2f8407c2e566da213b&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:23.017029 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 290/568] 10.222.0.16 () {56 vars in 1157 bytes} [Tue Aug 10 04:58:22 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:23.023897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:23.034354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e9be6-f3d8-4e8a-9070-f0b16fea7fbd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:23.043245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:23.044132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:23.044527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:23.044908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:23.058042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:23.060160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:23.080644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:23.081955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 279/569] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:23.088772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:23.103131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a127-1dab-4040-a268-e67c5639c88f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:23.110399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:23.111242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:23.111586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:23.111933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:23.112762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:23.113138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:23.116215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:23.129983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 291/570] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:23.136320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:23.147197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089751c5-0469-433c-9adf-6ff002c14c37 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:23.152230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:23.153049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:23.153329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:23.153655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:23.162221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:23.164335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:23.179296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:23.180886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 280/571] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:23.187461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:23.198690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acaf2b-fe36-4819-bad5-934ff803ed02 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:23.203841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:23.204581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:23.204867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:23.205144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:23.206090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:23.206405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:23.208464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5d59d-1d21-44d2-821b-b57efccb7a06 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:23.222745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 292/572] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:23.230178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:23.241174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb338d-c290-4073-9c15-ddcabbcf77db admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:23.246821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388c71f-9c9b-4a20-9cb5-7c62a8f8df81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:23.248022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388c71f-9c9b-4a20-9cb5-7c62a8f8df81 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:23.248499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388c71f-9c9b-4a20-9cb5-7c62a8f8df81 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:23.248943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388c71f-9c9b-4a20-9cb5-7c62a8f8df81 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/92f6a41de2f0409db2d99a8c3ee5b4a2/roles/661315ffc5a040a996976997e234726f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:23.266463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388c71f-9c9b-4a20-9cb5-7c62a8f8df81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=92f6a41de2f0409db2d99a8c3ee5b4a2, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:23.269516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388c71f-9c9b-4a20-9cb5-7c62a8f8df81 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:23.338554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 281/573] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:23 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/92f6a41de2f0409db2d99a8c3ee5b4a2/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:24.396710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440c8cb-7137-4ac2-88f3-27ef2560f495 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.397266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440c8cb-7137-4ac2-88f3-27ef2560f495 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.397558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440c8cb-7137-4ac2-88f3-27ef2560f495 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.399746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 293/574] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:24.405778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.406231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.406537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.431686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:24.433076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:24.506555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 282/575] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:24.544752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440c8cb-7137-4ac2-88f3-27ef2560f495 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.564439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440c8cb-7137-4ac2-88f3-27ef2560f495 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.575215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.576227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.576619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.577008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.599378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:24.606350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:24.608030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 294/576] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:24.614316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.627690 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025f04b-6fe3-453e-a355-6065d203d81c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.638266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.639144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.639571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.640011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.640908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:24.641361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:24.643137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:24.661037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 283/577] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:24.667215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.680205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ce1ef-e55b-42e2-a102-abd0ec5ca715 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.690855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.691824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.692221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.692609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.714381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:24.716450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:24.745228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:24.746928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 295/578] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:24.752665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.768215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe9ea-fac4-4bb1-a003-96fc4522fef7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.775711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.776587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.777037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.777567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.778426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:24.778944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:24.780914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:24.798740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 284/579] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:24.804869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.820045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9553bbfe-0b14-44ff-82c3-dc43966b5e4b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.831259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.832250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.832713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.833125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.852026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:24.854284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:24.875279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-9180bfa2-701e-4508-a7b8-d39dd8473388 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:24.876723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 296/580] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:24.883505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.895255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c62158-f312-4725-86e4-5f45aa6c115b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.895698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c62158-f312-4725-86e4-5f45aa6c115b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.896089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c62158-f312-4725-86e4-5f45aa6c115b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.898300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 297/581] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:24.900261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac425d0b-9556-4a52-8f8e-389cdb2b7643 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.903899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.904299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.904737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.906318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.907013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.907293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.907564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.908401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:24.908709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:24.911148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:24.929857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 285/582] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:24.931062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:24.932358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:24.935497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:24.945413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5328e42-fd32-414a-8cd4-2f15de528eb4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:24.946038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 298/583] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:24.961442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:24.962207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:24.962490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:24.962785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:24.975124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:24.976889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:24.993162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 286/584] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:24.996698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.001822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.013021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f827653a-9e49-413a-a926-26f76f0db32b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.016200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a416b6-b46e-4ba0-a0ec-08b8b86c64b5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.022556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.023356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.023636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.023906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.025536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.026326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.026618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.026891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.027544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.028546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:25.028546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:25.028546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:25.029606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.042109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.043958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.044140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 04:58:25.050551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 299/585] 10.222.0.16 () {56 vars in 1151 bytes} [Tue Aug 10 04:58:24 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:25.053256 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.063568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5687f-8fb4-48b2-a19c-28b712a5855b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.069457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.070145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.070424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.070896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.071600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.071901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.072959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:25.072959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:25.072959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:25.073890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.075301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:25.076800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 287/586] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:25.083503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.083789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 300/587] 10.222.0.16 () {56 vars in 1146 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:25.084943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.095187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0be0d1-4189-422f-a5c0-f20c4fe5471d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.097326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698814ff-f263-4a68-b3f7-7a74463680ab admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.100353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.101078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.101295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.101570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.102274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.102598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.103609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.104183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.104747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.105260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.105891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.107336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.107922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.109760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.116388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 301/588] 10.222.0.16 () {56 vars in 1146 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:25.145617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 288/589] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:25.151333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.167062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d624b1-4679-4c1a-a5fa-b9db1a03677a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.179847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.181071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.181556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.182077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.195928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.198545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.215003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:25.223244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 302/590] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:25.229781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.257335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867ea96-8f7c-4db9-96e6-5c7b8da9610c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.267943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.268589 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.268871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.269144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.270465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.270795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.272659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22206d95-46d0-448f-936c-9c8bdd4b4f14 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.296256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 289/591] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:25.303118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.317314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd08b30-f1bd-4de8-bea3-cc12c96326fb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.326654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.327608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.328028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.328436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.329486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=0b340b0c363a4c1ebaf9311b7349a6d2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.329938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.332059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d4a9f8-0c68-45ad-ac50-9ab5762d5a38 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.343005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 303/592] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/role_assignments?user.id=0b340b0c363a4c1ebaf9311b7349a6d2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:25.712138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6cdb9-5159-45ec-b7cc-fc53929721fe None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.712653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6cdb9-5159-45ec-b7cc-fc53929721fe None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.712726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a6cdb9-5159-45ec-b7cc-fc53929721fe None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.714718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 290/593] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:25.721038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fa8fe-2ee1-43ed-bd61-d01695593f0a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.721448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fa8fe-2ee1-43ed-bd61-d01695593f0a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.721675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9fa8fe-2ee1-43ed-bd61-d01695593f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.747605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3d9fa8fe-2ee1-43ed-bd61-d01695593f0a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:25.748825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3d9fa8fe-2ee1-43ed-bd61-d01695593f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:25.757171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 304/594] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:25.788440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6cdb9-5159-45ec-b7cc-fc53929721fe None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.805521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a6cdb9-5159-45ec-b7cc-fc53929721fe None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.815182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.815991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.816278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.816555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.817273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.818282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:25.818282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:25.818282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:25.819188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.832172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 04:58:25.833891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 291/595] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:25.839424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90010-7c07-4070-ae4c-9b54f4b71c8e None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.839782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90010-7c07-4070-ae4c-9b54f4b71c8e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.840058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90010-7c07-4070-ae4c-9b54f4b71c8e None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.840493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.842044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 305/596] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:25.847452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.847741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.848080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.855579 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5b375-a572-4c8b-b839-02d8d38615e2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.866733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.867586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.869050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.869467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.870334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.871376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:25.871882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.873022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:25.873022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:25.873022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:25.874543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:25.875678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.885739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 292/597] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:25.888794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 306/598] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:25.890106 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.907451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a6ed9-1955-414b-b90e-431af88590c5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.913864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.914819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.915242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.915659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.916545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] RBAC: Adding query filter params (type=network) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:25.917008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.918845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:25.927977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 293/599] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/services?type=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:25.942565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:25.952374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903f463-d8cf-4919-8517-f3d8a1f9335a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:25.958134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:25.959270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:25.959690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:25.960168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:25.972233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:25.974516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.001524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:26.003115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 307/600] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:26.010001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.022718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbae67-bf54-4359-abd3-14addecd91cb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.031125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.032146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.032572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.032986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.033918 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.034364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.036285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3f0a1-f121-4983-ac43-f6941910c3d3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.054939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 294/601] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:26.061260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.072121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5bf64-f846-4c2c-99db-ea9aeac7f285 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.077228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.078156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.078650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.079085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.080015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.082257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.122673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006541e4-8930-461f-bafc-0f0132dac9bb None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.123264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006541e4-8930-461f-bafc-0f0132dac9bb None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.123564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006541e4-8930-461f-bafc-0f0132dac9bb None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.125651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 295/602] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:26.131825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.132150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.132466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.153449 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:26.154700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:26.166331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 296/603] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:26.190562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.200510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad96136-5383-43b3-bab6-ba098c7f9fbe None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.209365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 308/604] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:26 2021] POST /identity/v3/users => generated 254 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:26.209498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.210315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.210876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.211210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.224539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:26.235147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:26.236801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 297/605] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:26.243500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.253624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd4011-51b1-4656-ae1a-2fc612894d50 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.259222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.259955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.260240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.260519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.261350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.261659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.263522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.273339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 309/606] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:26.279708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.290787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3a440-4c6d-42d7-895a-1baf74b2869a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.295664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.296506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.296831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.297112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.310190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.312178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.331095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:26.332740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 298/607] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:26.339327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.350417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093df691-5024-4afc-89a4-160c07dc7ae2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.355264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.356002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.356291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.356556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.357291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.357604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.359438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.373351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 310/608] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:26.380218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.391875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0103f27-a08a-4758-ba3b-5497369e9290 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.399387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.400208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.400491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.400822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.413294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.415474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.430897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 04:58:26.432198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 299/609] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:26.438424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.448854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e990f-71a1-4756-ac2f-9e96bb9f674d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.453517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.454269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.454550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.454913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.455806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.456113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.458187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.476895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 311/610] 10.222.0.16 () {56 vars in 1157 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:26.483096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.493730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13933ec9-1c09-40a3-aa97-c67440eeeaf8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.498290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.499012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.499400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.499708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.508037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.509900 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.519257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 300/611] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:26.525845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.535902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e414c1-a720-40c3-bd85-a01982d1cf55 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.541393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.542233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.542559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.542863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.554149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.556139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.573848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:26.575277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 312/612] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:26.581474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.592345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6996-f832-42e2-9b18-795252d1c412 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.597029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.597692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.598084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.598363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.599122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.599429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.601175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.614971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 301/613] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:26.621280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.631439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52170f4d-97c0-4431-9a97-9fae47e896a1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.636028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.636869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.637150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.637471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.645501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.647695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.661001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:26.662482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 313/614] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:26.668917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.679606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c3685-948c-46e5-b926-389f43551fa6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.684362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.685020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.685353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.685625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.686410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.686819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.688804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f86f8-9ebb-4a02-9219-c4e30a761a3c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.701369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 302/615] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:26.708287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:26.719008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaac0cf-cbc8-4829-93e1-84b74102c0ff admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:26.723617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:26.724296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:26.724532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:26.724824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:26.725652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=92f6a41de2f0409db2d99a8c3ee5b4a2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:26.725962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:26.727840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d027f2-5200-4d4d-873d-0f0c7b7dde51 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:26.734482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 314/616] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:26 2021] GET /identity/v3/role_assignments?user.id=92f6a41de2f0409db2d99a8c3ee5b4a2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:27.849044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311715-ac0d-4465-8fa3-276be5692e1a None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:27.849530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311715-ac0d-4465-8fa3-276be5692e1a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:27.849530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311715-ac0d-4465-8fa3-276be5692e1a None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:27.851603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 303/617] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:27.853206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8424-012b-4933-9e16-c5d9f0cd50ad None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:27.853582 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8424-012b-4933-9e16-c5d9f0cd50ad None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:27.853779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c8424-012b-4933-9e16-c5d9f0cd50ad None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:27.855532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 315/618] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:27.861373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:27.861660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:27.861937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:27.863197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:27.863476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:27.863811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:27.887320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:27.888514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:27.900956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:27.902125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:27.909219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 304/619] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:27.920780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 316/620] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:27.934123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:27.947958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50d28e-c945-4e5b-afce-7fc0d9692078 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:27.952535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:27.953332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:27.953611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:27.953876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:27.955328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:27.965431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:27.967348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f82b5-70b0-4b55-b46c-9a1c6d4ebbca None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:27.972375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:27.974439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 305/621] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:27.975946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:27.976614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:27.976896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:27.977164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:27.977896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:27.978922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:27.978922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:27.978922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:27.980587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:27.983193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:27.993132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ef81e-084d-48ff-ab9b-60382f5dbbcd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:27.997896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:27.998631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.004317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.004317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.004317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:28.004317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.004317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.011880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 306/622] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:28.018186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.029136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633aefb5-77f6-4557-ba7d-2a9f0e77e24c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.033862 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.034714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.035000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.035275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.046123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.048029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.065824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:28.067495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 307/623] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:28.073384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.084110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05360c-e6c4-4de9-ad9e-5cd08cbe9ef4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.089105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.089825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.090105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.090380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.091392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:28.091710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.093522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.106673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 308/624] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:28.119396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 317/625] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:27 2021] POST /identity/v3/services => generated 251 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:28.120381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.131082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c346d-2243-4dce-881b-841962ca9142 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.158255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.159199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.159488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.159764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.168355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.170620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.186965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:28.188607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 309/626] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/users/nova => generated 82 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:28.195051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.206043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5c24b-2dd4-4291-9d1f-8e43094ffeeb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.211768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.212500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.212782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.213053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.213948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:28.214252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.216371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.236866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 318/627] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:28.243795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.260867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f35b-697f-49d0-9792-a7832ed889d0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.265642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.266447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.266768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.267027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.283022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.284895 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.312578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:28.314155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 310/628] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:28.320236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.340776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373bdde-6126-4af6-98c1-16a83be77d0e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.349476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.350156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.350436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.350781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.351519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:28.351874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.353570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.372638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 319/629] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:28.378697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.391565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d826e7-88ff-436b-80ab-bb57a4133f45 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.396000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.396785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.397061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.397329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.404310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.406254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.419620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:28.421089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 311/630] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:28.427000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.438708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d741f8-bf4e-43f5-8870-94e8887ac1b9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.444055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.444794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.445083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.445359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.446180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:28.446493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.448556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b682b-91e4-4992-abb3-a85098a520ee admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.463344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 320/631] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:28.469902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.481648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc7e83-1bb3-4d98-835f-900a1db103b5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.486158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1496f4-5f6e-47c6-b7f2-00da52039546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.487162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1496f4-5f6e-47c6-b7f2-00da52039546 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.487352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1496f4-5f6e-47c6-b7f2-00da52039546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.487622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1496f4-5f6e-47c6-b7f2-00da52039546 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/0b340b0c363a4c1ebaf9311b7349a6d2/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.489643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1496f4-5f6e-47c6-b7f2-00da52039546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=0b340b0c363a4c1ebaf9311b7349a6d2, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.492329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1496f4-5f6e-47c6-b7f2-00da52039546 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.519336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7eae8-e51c-4442-a258-d141b16c17f5 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.519648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7eae8-e51c-4442-a258-d141b16c17f5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.519950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7eae8-e51c-4442-a258-d141b16c17f5 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.521995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 321/632] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:28.528190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.528482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.528763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.548987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:28.550242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:28.560526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 322/633] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:28 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:28.562727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 312/634] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:28 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/0b340b0c363a4c1ebaf9311b7349a6d2/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 04:58:28.588236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:28.598600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5cbad-f106-42ce-87ba-5cef9ead30c2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:28.657897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e624c-f162-4068-8597-7b8552efb5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:28.658545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e624c-f162-4068-8597-7b8552efb5bb admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:28.658868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e624c-f162-4068-8597-7b8552efb5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:28.659143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e624c-f162-4068-8597-7b8552efb5bb admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:28.659905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e624c-f162-4068-8597-7b8552efb5bb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:28.662125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e624c-f162-4068-8597-7b8552efb5bb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:28.745613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 323/635] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:28 2021] POST /identity/v3/services => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:29.123851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67e506-6ab1-4b67-addf-45c63a040233 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.124370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67e506-6ab1-4b67-addf-45c63a040233 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.124478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67e506-6ab1-4b67-addf-45c63a040233 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.126464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 313/636] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:29.135531 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.135999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.136078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.156419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:29.157597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:29.182498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 324/637] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:29 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:29.214845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67e506-6ab1-4b67-addf-45c63a040233 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.232561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67e506-6ab1-4b67-addf-45c63a040233 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.240646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.241445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.241724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.241992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.256915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:29.263884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:29.265084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 314/638] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:29.271675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.280972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ba917-d37e-4d5e-ab76-3fc802f66a34 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.289517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.290201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.290478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.290777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.291530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:29.291838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.293429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.309935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 325/639] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:29.315663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.331667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53216f6d-f234-4b49-8a20-d0b3d32a08c0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.336415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.337211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.337491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.337763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.361097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.363043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.387928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:29.389344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 315/640] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:29.395448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.416969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f8ba5-8b7d-4093-8f90-9f5aabcf7c58 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.431189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.431859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.432144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.432422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.433150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:29.433459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.435094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.450132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 326/641] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:29.455823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.471509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251f9e3-f626-4b1f-a225-e06adb88bf4e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.475982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.476783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.477061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.477329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.499798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.501831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.523157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 04:58:29.524675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 316/642] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:29.532905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.547481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd464e-304b-4ca6-9344-b24a3d004ae6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.558898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.559575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.559858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.560130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.560977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:29.561283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.563172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.588880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 327/643] 10.222.0.16 () {56 vars in 1171 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:29.594700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.607635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fc895-641a-441f-8194-ee63a9b31768 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.612041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.612682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.612962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.613233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.630211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.632001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.644138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 317/644] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:29.650722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.663200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2a64b-7821-4dd5-a8fc-6822f1adc938 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.671053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.671894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.672180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.672459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.686965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.688864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.709108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:29.710305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 328/645] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:29.716677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.731629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06f102-021c-49e3-899a-de67f68f4c53 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.736434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.737118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.737399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.737676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.738421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:29.739297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.740960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.767936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 318/646] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:29.774457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.788079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4a3d6-8a23-4db6-ac56-5d1b0163832d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.797609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.798699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.799198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.799684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.814076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.816586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.837468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:29.839546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 329/647] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:29.845489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.859916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d3a60c-50d6-4baa-b481-aac8ad1bcf72 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.864456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.865114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.865392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.865663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.866443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:29.866772 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.868607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4746c9c-f3c0-44a3-8f36-91b3c99bd84c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.895759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 319/648] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:29.902241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:29.917498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd8f70-07fa-4cbe-8e2b-30e50727ae35 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:29.926003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794d3d-ab40-4ab3-864d-0984f648f22b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.926367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794d3d-ab40-4ab3-864d-0984f648f22b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.926681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb794d3d-ab40-4ab3-864d-0984f648f22b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.927869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:29.928753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 320/649] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:29.929075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.929597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.930128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.931195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=390faf536fad46aca3a8a433da441e7d) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:29.931738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:29.934473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:29.934791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:29.935065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:29.936196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:29.943816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 330/650] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/role_assignments?user.id=390faf536fad46aca3a8a433da441e7d&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:29.959404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:29.960903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:29.969345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 321/651] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:29 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:29.995982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.012517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2ca56-80f7-4cad-be01-9110f92d46c8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.023247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.024431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.024929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.025438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.044183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:30.052388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:30.060552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 331/652] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:30.067022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.082729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833bf24-47db-42fb-b23d-48c80b916700 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.087765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.088452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.088734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.089008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.089776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:30.090080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.091821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.102021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 322/653] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:30.108409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.119617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c18e6-fe56-43c8-8081-eb3104aa2c53 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.124317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.125154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.125431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.125704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.137486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.139422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.155853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:30.157257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 332/654] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:30.163979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.174138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd17a1-bd45-48f8-9c58-ab8b98c866d5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.178851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.179629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.179908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.180182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.180904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:30.181259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.182882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.196111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 323/655] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:30.202285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.212724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dcbf3-349d-49e9-a1bf-52d0116189e4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.217472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.218315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.218631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.218956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.227731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.229810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.244089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 04:58:30.245633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 333/656] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:30.252016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.266483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36faa3-1c4d-4b9b-a941-b229f26eac3e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.271302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.272029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.272308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.272579 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.273459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:30.273789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.275785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.303604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 324/657] 10.222.0.16 () {56 vars in 1157 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:30.311703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.326749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b543a-2739-4659-8b93-af3af700c14f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.334325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.335047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.335328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.335858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.344370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.346191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.355621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 334/658] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:30.361995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.378823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6991c-9c59-4a4f-bc2e-fab28208c5d0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.384297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.385144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.385468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.385740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.396374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.398195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.414897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:30.416342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:30.422491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.431999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3149d-fbe4-416e-9704-b088c2810cec admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.436670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.437383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.437663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.437935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.438741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:30.439091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.440830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.455357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 335/660] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:30.461832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.471625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b7869-68e0-4f6c-ad2c-9eca6ab853d0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.476186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.477015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.477295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.477616 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.484935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.487139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.500880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:30.502371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 326/661] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:30.508767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.533762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64fb37-709c-4508-ad12-9b5a2c07e384 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.547737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.548408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.548693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.548966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.549753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:30.550055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.552467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf24e5ff-82a0-42ee-8d42-8e69cb98218b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.574877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 336/662] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:30.582083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:30.602654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47420ccc-8742-490b-b6eb-d4f70c5f3fc1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:30.607427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:30.608365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:30.608917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:30.609391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:30.610520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=92f6a41de2f0409db2d99a8c3ee5b4a2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:30.619111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:30.621236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29950407-f65a-40a2-a3b1-8c296165c951 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:30.627592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 327/663] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:30 2021] GET /identity/v3/role_assignments?user.id=92f6a41de2f0409db2d99a8c3ee5b4a2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.052864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6bd76-f0aa-4f99-bae2-1b730b16ae5c None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.053243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6bd76-f0aa-4f99-bae2-1b730b16ae5c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.053427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6bd76-f0aa-4f99-bae2-1b730b16ae5c None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.055478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 337/664] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:31.064610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.065190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.065677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.089951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:31.091524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:31.102023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 328/665] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:31 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:31.125184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6bd76-f0aa-4f99-bae2-1b730b16ae5c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.140266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6bd76-f0aa-4f99-bae2-1b730b16ae5c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.149708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.150929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.151425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.151898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.152815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.154634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.170027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 04:58:31.171533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 338/666] 10.222.0.16 () {56 vars in 1151 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.178174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.191584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fd01b-3fe9-4500-bdb5-e5f8564e1915 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.196532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.197532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.198082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.198555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.199509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.200016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.201946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.211739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 329/667] 10.222.0.16 () {56 vars in 1146 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.218066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.229889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9675c-d7ae-4e71-8edc-f0ac4abca9b0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.236769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.237869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.238359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.239028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.240073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.240609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.242546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.251235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 339/668] 10.222.0.16 () {56 vars in 1146 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.257568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.268875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d47f40-e619-44a2-a3df-8eabd4486e6c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.274384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.275338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.275824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.276316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.277366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] RBAC: Adding query filter params (interface=public, service_id=262ba4e54bf540b1be437f516b6f697a, region_id=RegionOne) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.277878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.283159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:31.283159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:31.283159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:31.284460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3612a-1d59-433b-8351-7ec1fef7dccb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.293275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 330/669] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/endpoints?service_id=262ba4e54bf540b1be437f516b6f697a&interface=public®ion_id=RegionOne => generated 194 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.299253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.307971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18178bb-95a1-4385-991d-982108f5ea29 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.308652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18178bb-95a1-4385-991d-982108f5ea29 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.310860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66060b-a004-4f67-a595-691e47c15e44 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.312384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18178bb-95a1-4385-991d-982108f5ea29 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.317235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 331/670] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:31 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:31.319023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.319898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.320444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.320916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.321850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.323069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.323349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.323670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.328161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.337955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 340/671] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services => generated 772 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.360828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:31.362138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:31.374642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 332/672] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:31 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:31.413201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.425540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534cbb6-fee6-48fb-bd11-a0ddcee93728 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.434641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.435512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.435793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.436112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.455545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:31.463421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:31.464873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 341/673] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.471258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.483603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3753030-0962-4d4e-9317-39356182cbc2 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.488182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.488928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.489209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.489484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.490229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.490533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.492191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.507428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 333/674] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.513649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.528689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955715a-7fc1-44a4-b332-bfbffc752db6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.533406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.534253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.534540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.534893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.554316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.556217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.578075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:31.579569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 342/675] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.587041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.599053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad823834-4c94-495f-90bf-87aa3131bc13 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.603819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.604574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.604915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.605190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.605924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.606276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.607985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.626916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 334/676] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.633611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.644296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13183364-669f-4d70-ab5b-a148ebe3444f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.650801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.651610 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.651890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.652163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.663291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.665355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.679970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-368a3b07-a775-4c8d-97cb-b6e79a613c36 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:31.681581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 343/677] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.687449 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.700892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf61b2b-0d0a-4b72-b0a0-7b8d9811b8a3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.705381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.706048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.706332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.706626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.707509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.707817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.709647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.714991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a221df-00ad-40b8-b7cd-52afdec15fc4 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.715357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a221df-00ad-40b8-b7cd-52afdec15fc4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.715710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a221df-00ad-40b8-b7cd-52afdec15fc4 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.717802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 344/678] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:31.723429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.723787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.724155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.729833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 335/679] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.735972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.743495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:31.744712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:31.747261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b6c1a-6de3-44b8-96f1-4606f766b79b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.752820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.753441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 345/680] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:31 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:31.753881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.754387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.754898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.763849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.765828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.776931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 336/681] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:31.781965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.783107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.789344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43187a10-3fe9-4940-a2f2-44ffec90102d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.792630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684830-2bbe-4322-9579-7f3d5215e139 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.793995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.794783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.795061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.795338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] PATH_INFO: `/v3/services/network` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.795996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.797584 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.799034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.800077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.800598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.801073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.810918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 04:58:31.812073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.812184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 346/682] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services/network => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.814272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.819186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.829165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2a1ae-057e-422e-98b4-10490927d166 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.834351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.835202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.835444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:31.835548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.836226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.836995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] RBAC: Adding query filter params (name=network) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.837365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.838002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 337/683] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.842634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.844297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.844598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 347/684] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services?name=network => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.850674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.854667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977fcae-e0e2-4f5f-80d1-da305baede18 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.864693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.865603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.866080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.866743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.868522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.868834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b245a0-b7ca-46da-b70d-a272014f923d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.869325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.872178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.877792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.879162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.880498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.882008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.884885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] RBAC: Adding query filter params (type=network) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.885409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.887253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.895776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 338/685] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.898464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 348/686] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services?type=network => generated 350 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.902160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.905118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.919946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c343b-5bf0-4ff7-a505-46998787232a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.922292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c852e-a4f4-48e8-87af-9b14d7a1e57a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.930875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.933015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.933197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.934052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.934500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.935006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.935463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.936242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.937448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] RBAC: Adding query filter params (interface=public, service_id=d252a5d658a74484bbca7d13a4e8f27d, region_id=RegionOne) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:31.939373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.940719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:31.940719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:31.940719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:31.944821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.951098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.954557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:31.959968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 349/687] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/endpoints?service_id=d252a5d658a74484bbca7d13a4e8f27d&interface=public®ion_id=RegionOne => generated 194 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:31.966383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.983710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acc881-c0c1-492d-ad96-07f664f9fcd4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:31.986359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:31.990438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 339/688] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:31.991822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:31.992785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:31.993241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:31.993728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:31.994641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:31.996790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:31.998450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.008102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba71ccd-2a3e-4742-8bcf-d203dfb849eb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.013067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.014028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.014500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.014976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.015959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:32.016442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.016995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 350/689] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/services => generated 772 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:32.018874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3a113-a408-4dbe-b754-35b11aada4d4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.033630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 340/690] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:32.041168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.060157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633fff8-a8b9-4be7-b271-f32737099013 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.075459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.076151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.076438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.076742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.077564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=0b340b0c363a4c1ebaf9311b7349a6d2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:32.077876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.079894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ebc99-abed-47cd-99be-11f907c5def2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.087757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 351/691] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/role_assignments?user.id=0b340b0c363a4c1ebaf9311b7349a6d2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:32.412890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2978-10a2-48d6-b78e-6135a64ab1fa None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.413374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2978-10a2-48d6-b78e-6135a64ab1fa None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.413374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be2978-10a2-48d6-b78e-6135a64ab1fa None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.415615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 341/692] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:32.421270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.421672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.421830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.443285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:32.444477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:32.452464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 352/693] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:32 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:32.478300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be2978-10a2-48d6-b78e-6135a64ab1fa None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.492280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be2978-10a2-48d6-b78e-6135a64ab1fa None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.496922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.497766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.498049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.498324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.509865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:32.522350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:32.523882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 342/694] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:32.533085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.547668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b88c2-8cdc-42c2-934e-04ec3055cb0c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.556105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.556781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.557063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.557339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.558094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:32.558404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.560036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.578028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 353/695] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:32.584577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.595153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47aec-72be-4a94-a6f9-4143dd89df8d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.599810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.600646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.600930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.601204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.611815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.614560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.641231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:32.642870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 343/696] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:32.649635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.669112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f7244-cd6a-4cda-9998-4f038095a58c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.678360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.679068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.679351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.679713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.680443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:32.680750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.682352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.698531 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 354/697] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:32.704383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.719546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c3704-bafb-4633-9033-5a76d426159d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.727113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.727966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.728245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.728514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.739228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.741313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.762674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 04:58:32.764239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 344/698] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:32.770905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.784448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f64af0e-5b82-441c-a86d-b6506c331543 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.791362 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.792033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.792314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.792590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.793519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:32.793834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.795710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.826195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 355/699] 10.222.0.16 () {56 vars in 1171 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:32.831978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.847672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fa89d3-5ec1-4a79-b453-66c3fef2c8d8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.855664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.856598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.856882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.857157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.872947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.874913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.896152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:32.897549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 345/700] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:32.903551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.919816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9589ed-69d5-4f38-ab85-6435f34c37b9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.933567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.934241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.934525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.934828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.935552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:32.935857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.937495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:32.951835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 356/701] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:32.958346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:32.969002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf8bd8-5810-478e-a72b-5d223d2be005 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:32.976358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:32.977891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:32.978371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:32.978952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:32.991920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:32.993949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.013885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:33.015282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 346/702] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:33.022723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.036539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a445f74-ac7d-41ec-9124-49d3ead40074 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.054609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.054609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.054609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.054609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.055396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:33.055396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.056753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e93dd5-f581-4147-9201-9a853ed9a18e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.075776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 357/703] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:33.081943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.100928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd5c5d-fb47-40bb-a5e8-bffe29cdc548 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.110024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.110966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.111250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.111526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/390faf536fad46aca3a8a433da441e7d/roles/661315ffc5a040a996976997e234726f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.134487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=390faf536fad46aca3a8a433da441e7d, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.137251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.194777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d1763-4c54-4c4d-9f8c-273a6e9e0890 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.195365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d1763-4c54-4c4d-9f8c-273a6e9e0890 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.195840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d1763-4c54-4c4d-9f8c-273a6e9e0890 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.198076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 358/704] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:33.204178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.204702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.205292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.224436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:33.225707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 347/705] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:33 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/390faf536fad46aca3a8a433da441e7d/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:33.226300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:33.290382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 359/706] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:33 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:33.316681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.337200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4129b99-201f-417e-84eb-ddf595a8f0fe admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.347043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.347873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.348735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.349017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.367803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:33.374720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:33.376256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 348/707] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:33.383130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.396459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61be2b1-78cb-44e5-8368-80f697d844f2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.404736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.405847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.406386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.406879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.407844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:33.408366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.410325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.430425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 360/708] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:33.437840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.452861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b68af-51d5-4a92-9135-89c7ce588257 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.464627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.465434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.465718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.465994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.480076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.481948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.508964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:33.513864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 349/709] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:33.520516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.532374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e154a6-cccd-4826-9a1d-bb2aa855b488 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.537070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.537889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.538171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.538449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.539246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:33.539549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.541204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.554445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 361/710] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:33.562876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.573529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438b916-c3f8-4077-948a-f72ceecf9253 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.578206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.579082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.579363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.579686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.589105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.591221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.606377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 04:58:33.607925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 350/711] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:33.614287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.624449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24961a32-ddcb-4648-9a6a-2af47b24b833 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.629119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.630371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.630691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.630965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.631857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:33.632162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.634125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.653239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 362/712] 10.222.0.16 () {56 vars in 1157 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:33.659405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.670945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a59fa3-d81c-42aa-a6a9-b79bd8d10207 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.681685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.682527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.682831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.683157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.698424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.700333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.725273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:33.729282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 351/713] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:33.732931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.743739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d6137-b312-4902-8cc5-29eab6517974 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.748392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.749143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.749426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.749700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.750466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:33.750812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.752464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.764700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 363/714] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:33.770911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.781026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705365ad-ba6b-4ea9-b170-cacd4e9e0a24 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.786256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.787154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.787525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.787802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.799783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.802443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.819378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:33.820587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 352/715] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:33.827009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.839163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95acda-ec39-4baa-ad3d-8ee9a2a1f494 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.848636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.849294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.849573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.849840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.850635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:33.850946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.852816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4bb0ac-208b-4b99-a233-c632cf50056e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:33.869763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 364/716] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:33 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:33.876231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:33.887429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f3a1dd-2767-4111-96c4-cca4b15e905e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:33.892025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97768a96-19cf-4aef-b96d-5a8f4620ed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:33.892998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768a96-19cf-4aef-b96d-5a8f4620ed58 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:33.893322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768a96-19cf-4aef-b96d-5a8f4620ed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:33.893599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97768a96-19cf-4aef-b96d-5a8f4620ed58 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/92f6a41de2f0409db2d99a8c3ee5b4a2/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:33.895697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97768a96-19cf-4aef-b96d-5a8f4620ed58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=92f6a41de2f0409db2d99a8c3ee5b4a2, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:33.898439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97768a96-19cf-4aef-b96d-5a8f4620ed58 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.019083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 353/717] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:33 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/92f6a41de2f0409db2d99a8c3ee5b4a2/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:34.175921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437e1d-9436-434c-afd8-8a757f298691 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.175921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437e1d-9436-434c-afd8-8a757f298691 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.175921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c437e1d-9436-434c-afd8-8a757f298691 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.177220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 365/718] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:34.183847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.184452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.184923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.203453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:34.205032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:34.266200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 354/719] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:34 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:34.291472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c437e1d-9436-434c-afd8-8a757f298691 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.305501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c437e1d-9436-434c-afd8-8a757f298691 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.310882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.312011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.312530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.313005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.313871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.315792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.328379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 10 04:58:34.330237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 366/720] 10.222.0.16 () {56 vars in 1151 bytes} [Tue Aug 10 04:58:34 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:34.337520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.347011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed066c-a858-47f2-9e7b-b038f58b6d04 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.352546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.353522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.354070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.354633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.355566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:34.356072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.357935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.363558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 355/721] 10.222.0.16 () {56 vars in 1146 bytes} [Tue Aug 10 04:58:34 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:34.369977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.381179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5866b-f93b-41bf-8be1-b3833b17f70e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.386204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.387191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.387743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.388218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.389168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:34.389669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.391559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd9145-4295-4a0a-ab53-527883171076 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.397608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 367/722] 10.222.0.16 () {56 vars in 1146 bytes} [Tue Aug 10 04:58:34 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:34.404003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.413836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687071f-59e8-47c5-b4b5-87aece568e6b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.419994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.420643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.420922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.421192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.421925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.422955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:34.422955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:34.422955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:34.423833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa97670-95a2-4eb8-a538-627bef86d656 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.535436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 356/723] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:34 2021] POST /identity/v3/endpoints => generated 346 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:34.608155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632bfa8-8ff7-4ad7-8f9f-4f9a76f46a2f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.609128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632bfa8-8ff7-4ad7-8f9f-4f9a76f46a2f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.609626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632bfa8-8ff7-4ad7-8f9f-4f9a76f46a2f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.611721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 368/724] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:34 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:34.622494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.622805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.623077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.655825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:34.657059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:34.680137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 357/725] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:34 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:34.717833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632bfa8-8ff7-4ad7-8f9f-4f9a76f46a2f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.740896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632bfa8-8ff7-4ad7-8f9f-4f9a76f46a2f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.751328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.752502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.752986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.753459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] PATH_INFO: `/v3/services/network` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.754391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.756269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.767927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 10 04:58:34.769691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 369/726] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:34 2021] GET /identity/v3/services/network => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:34.776299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.785620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae4ca53-cd1c-4fbd-a3bd-f4d8558b8d67 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.798235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.799064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.799347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.799623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.800335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] RBAC: Adding query filter params (name=network) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:34.800640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.802326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.808750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 358/727] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:34 2021] GET /identity/v3/services?name=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:34.814869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.824992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77703b-0c79-4fb5-b5b0-51d4b55bc75d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.831007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.831895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.832380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.833394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.834299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] RBAC: Adding query filter params (type=network) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:34.834870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.836904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da9b0-7000-462a-9f6d-6f6720e466f5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.844204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 370/728] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:34 2021] GET /identity/v3/services?type=network => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:34.854597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:34.860948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4d0e8-3bfc-49de-9ac2-33f5981c4294 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:34.871831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63751ba3-d621-4bbe-8abe-fffc09ebcacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:34.872773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751ba3-d621-4bbe-8abe-fffc09ebcacb admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:34.873311 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751ba3-d621-4bbe-8abe-fffc09ebcacb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:34.873784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63751ba3-d621-4bbe-8abe-fffc09ebcacb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:34.874839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751ba3-d621-4bbe-8abe-fffc09ebcacb admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:34.876681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63751ba3-d621-4bbe-8abe-fffc09ebcacb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:34.993980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 359/729] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:34 2021] POST /identity/v3/endpoints => generated 327 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:35.301173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856490f-86e1-48f1-bc0e-bfa284b3352d None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.301921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856490f-86e1-48f1-bc0e-bfa284b3352d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.302412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856490f-86e1-48f1-bc0e-bfa284b3352d None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.304725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 371/730] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:35.311518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302e1e-38da-49e1-af55-692ab564003b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.311659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302e1e-38da-49e1-af55-692ab564003b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.311920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01302e1e-38da-49e1-af55-692ab564003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.331680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-01302e1e-38da-49e1-af55-692ab564003b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:35.332933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-01302e1e-38da-49e1-af55-692ab564003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:35.352167 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 360/731] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:35 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:35.377539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856490f-86e1-48f1-bc0e-bfa284b3352d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:35.397075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856490f-86e1-48f1-bc0e-bfa284b3352d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:35.402078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:35.403188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.403671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.404160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.405063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:35.407098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:35.419310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 04:58:35.421108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 372/732] 10.222.0.16 () {56 vars in 1154 bytes} [Tue Aug 10 04:58:35 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:35.427940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302e1e-38da-49e1-af55-692ab564003b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:35.437422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01302e1e-38da-49e1-af55-692ab564003b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:35.443079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:35.444025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.444524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.444995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.445974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:35.446479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:35.448308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c4834-d851-453e-aa4a-4eabf8037f98 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:35.454777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 361/733] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:35 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:35.463148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:35.473543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9248f5-ae53-4de1-aaae-a1bd21045406 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:35.478484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:35.479441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.479965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.480438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.481402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:35.481929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:35.483850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe98fee-a5a8-495c-96a8-54881aec8fe8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:35.489912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 373/734] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:35 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:35.851588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bbfca-92ea-4901-9762-0ef1b6a4c008 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.852141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bbfca-92ea-4901-9762-0ef1b6a4c008 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.852141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bbfca-92ea-4901-9762-0ef1b6a4c008 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.854162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 362/735] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:35.860054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.860464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.860630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.878258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:35.879996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:35.894676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 374/736] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:35 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:35.912438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bbfca-92ea-4901-9762-0ef1b6a4c008 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:35.925321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bbfca-92ea-4901-9762-0ef1b6a4c008 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:35.930074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:35.930949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.931231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.931505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.942990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:35.949941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 04:58:35.956673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 363/737] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 04:58:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:35.958098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:35.967394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966cfd2-508c-4b6c-8008-82e3587c98fc None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:35.971982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:35.972641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:35.972925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:35.973714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:35.974457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:35.974785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:35.976366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:35.989185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 375/738] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 04:58:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:35.991090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.001680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42687fab-d700-4450-830f-62788e1bae67 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.007045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.007916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.008199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.008526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.019255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.021245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.038794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:36.045136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 364/739] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:36.046462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.057297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5ad4-fd41-4b33-b972-dd43f6261a9b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.061969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.062649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.062978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.063250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.064011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.064318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.065954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.082699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 376/740] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:36.084280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.094531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24954-fb6f-4667-a769-b4ae1f1ee59e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.099789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.100641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.100922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.101242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.108969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.112261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.127203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 04:58:36.133529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 365/741] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:36.134869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.144731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1dc5a-892d-4bbb-82d5-06abc2a12976 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.149477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.150173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.150459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.150759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.151643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.151945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.153820 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.174807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 377/742] 10.222.0.16 () {56 vars in 1171 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.178567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.188688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b250d-7cbf-4b09-8a90-4a6c4400e643 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.193851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.194531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.194852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.195175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.203933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.205749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.215723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 366/743] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:36.222144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.232198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34293842-f3cb-430a-bd64-c67f39aa1b69 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.236952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.237731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.238010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.238282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.249961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.252085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.269719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:36.276239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 378/744] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:36.277626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.286941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa74aa-f59e-4d8a-be92-3fa647467bc5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.291731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.292387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.292715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.292988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.293707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.294005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.295673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.313373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 367/745] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.314751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.324733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c5bb9-8e9f-4bdb-a9ec-e474708ad951 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.329429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.330261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.330544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.330847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.338926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.340928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.354070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:36.358853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 379/746] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:36.362204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.372842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b10ad3-13b6-41f5-a484-b0b7f44d6018 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.377547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.378202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.378526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.378840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.379798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.380105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.382018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55f966-1dec-4d6d-94b2-dc54b4a9aabf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.400481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 368/747] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.403196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.414059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64504f8-31f0-487f-a523-eabae8de8b68 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.419073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.420025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.420520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.421046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.422064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=390faf536fad46aca3a8a433da441e7d) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.422647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.424831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6a17f-5a62-480b-ba5f-91238cf4f330 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.432225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 380/748] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/role_assignments?user.id=390faf536fad46aca3a8a433da441e7d&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.533768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59012a5f-982d-4006-8cbe-71a6b8c75ffc None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.534068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59012a5f-982d-4006-8cbe-71a6b8c75ffc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.534321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59012a5f-982d-4006-8cbe-71a6b8c75ffc None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.536466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 369/749] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:36.542797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.543379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.543877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.563631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:36.565333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:36.574651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 381/750] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:36 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:36.599142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59012a5f-982d-4006-8cbe-71a6b8c75ffc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.611736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59012a5f-982d-4006-8cbe-71a6b8c75ffc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.618660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.619398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.619681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.619952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.632979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:36.640415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:36.642031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 370/751] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:36.649799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.659240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb9cd4-756c-432c-a574-8a6312b762c9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.664596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.665511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.666007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.666498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.667475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.667977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.669771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.679094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 382/752] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.685468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.695887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689e306-8ee1-4515-a00d-7473c3374e28 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.700575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.701648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.702133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.702627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.715379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.717541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.735716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:36.737555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 371/753] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:36.744091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.754880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425e57d-8d5e-4317-99d3-f3137c7d6de1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.759787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.760851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.761338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.761837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.762819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.763333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.765259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.779495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 383/754] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.786612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.796924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476315a4-a1e7-4c5c-bbff-650a72eadebf admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.801869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.803017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.803543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.804024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.813573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.816045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.830771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 10 04:58:36.832864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 372/755] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:36.840006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.851578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d01a4-8db5-4327-9957-03028f263d44 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.856760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.857879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.858360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.858855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.859990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:36.860514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.863170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa09704-2051-4ff9-918b-d6a715d185ec admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.882076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 384/756] 10.222.0.16 () {56 vars in 1157 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:36.888855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.898752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f926c-96c3-481e-92d2-9eabf932b189 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.899310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f926c-96c3-481e-92d2-9eabf932b189 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.899792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f926c-96c3-481e-92d2-9eabf932b189 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.900999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ae214-e0b8-4eb4-9213-ce9191046d0a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.902369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 385/757] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:36.907969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.908240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.908515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.911415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.912388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.912863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.913409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.922281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.924258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.927192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:36.928444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:36.937283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 373/758] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:36.944069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 386/759] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:36 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:36.945115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.954034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741c26-861f-47d0-b459-8afaa8ac5ced admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.959492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.960558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.961315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.961827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.967845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:36.973584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.975645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.976771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e213e8-274c-4c4e-aeac-ae29c52df7bf None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:36.981365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:36.982147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:36.982431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:36.982767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:36.983427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:36.985012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:36.996022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:36.996484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 04:58:36.997782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 387/760] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:36.998199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 374/761] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:37.003990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.005235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.014377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef3b6a-e672-4296-b8b6-6da81ec15029 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.016247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097bf94f-54b6-465f-8509-7429fdce1cd9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.019390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.020113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.020611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.020913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.021737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:37.022117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.022387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.023225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.023674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.024129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.024229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.025094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:37.025721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.028058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.029487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 388/762] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:37 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:37.035634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.041049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 375/763] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:37.046551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed1bdc-9c3e-4162-80fc-2a446339e990 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.047428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.052059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.052713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.052997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.053326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.054078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:37.054430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.056148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.059490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0b6c7-412c-42d6-b429-4645da346f40 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.060915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 389/764] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:37 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:37.064460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.065538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.066017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.066484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.074565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.076935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.092200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:37.094149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 376/765] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:37.101077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.112120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a731f-e560-422e-bf6b-643f8a635400 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.117883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.118975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.119457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.119927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.120927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:37.121439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.123623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e47876-ee0b-457e-97f0-646434b8463c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.137214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 390/766] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:37.144192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.155738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068432ed-e9f4-49b0-a28b-901ec1bf0c74 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.160852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.161797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.162275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.162770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.163820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=92f6a41de2f0409db2d99a8c3ee5b4a2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:37.164330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.166433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db2f31-b1d7-419a-aaa9-b1dfbf4db14d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.173243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 377/767] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:37 2021] GET /identity/v3/role_assignments?user.id=92f6a41de2f0409db2d99a8c3ee5b4a2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:37.753280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1967ae4-b026-4848-bfa7-d911f556b420 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.753661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1967ae4-b026-4848-bfa7-d911f556b420 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.753865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1967ae4-b026-4848-bfa7-d911f556b420 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.756152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 391/768] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:37.762786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc4b9-6964-4926-b79a-431eca18319d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.763110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc4b9-6964-4926-b79a-431eca18319d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.763343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476dc4b9-6964-4926-b79a-431eca18319d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.782005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-476dc4b9-6964-4926-b79a-431eca18319d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:37.783299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-476dc4b9-6964-4926-b79a-431eca18319d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:37.794688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 378/769] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:37 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:37.815496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1967ae4-b026-4848-bfa7-d911f556b420 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:37.827956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1967ae4-b026-4848-bfa7-d911f556b420 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:37.832314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb5802-6801-42bc-977b-da623af71c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:37.833489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5802-6801-42bc-977b-da623af71c00 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:37.833764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5802-6801-42bc-977b-da623af71c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:37.834032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb5802-6801-42bc-977b-da623af71c00 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:37.834785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb5802-6801-42bc-977b-da623af71c00 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:37.836630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb5802-6801-42bc-977b-da623af71c00 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:37.910841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 392/770] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:37 2021] POST /identity/v3/services => generated 269 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:38.747597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317e31-63c5-4eb9-930e-46123c6f58de None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:38.748320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317e31-63c5-4eb9-930e-46123c6f58de None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:38.748320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a317e31-63c5-4eb9-930e-46123c6f58de None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:38.750163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 379/771] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:38.756287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:38.756573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:38.756852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:38.775509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:38.776626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:38.798687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 393/772] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:38 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:38.820021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317e31-63c5-4eb9-930e-46123c6f58de None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:38.832612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a317e31-63c5-4eb9-930e-46123c6f58de None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:38.837349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:38.838148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:38.838425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:38.838743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:38.849683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:38.857036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 04:58:38.862686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 380/773] 10.222.0.16 () {56 vars in 1142 bytes} [Tue Aug 10 04:58:38 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:38.865156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:38.874423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7242b6-7f18-4d68-ae91-b8fc435b5b95 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:38.879107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:38.880456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:38.880739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:38.881013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:38.881758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:38.882059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:38.883687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:38.897720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 394/774] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:58:38 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:38.899105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:38.909003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1f10-297f-4d94-ad26-36cd24e09a54 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:38.914074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:38.914936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:38.915212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:38.915485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:38.926855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:38.928694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:38.945659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:38.950701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 381/775] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:38.953474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:38.964132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffb345-660c-4a76-b9af-7f4d1e6aedd6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:38.968882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:38.969616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:38.969868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:38.970181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:38.970933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:38.971235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:38.972832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:38.992306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 395/776] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:38.993664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.003760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfa6a0-544c-461a-8541-e869d048a722 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.009061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.009917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.010194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.010477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.018910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.021242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.035253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 04:58:39.042244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 382/777] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:58:38 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:39.043611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.053737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eee006-37f9-4a5a-82ab-1ed6cc4e0e21 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.058477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.059214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.059493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.059764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.060643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:39.060946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.062935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.086721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 396/778] 10.222.0.16 () {56 vars in 1171 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:39.088949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.100141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523d256-4452-47bb-b69c-40bffc4a9e6e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.105169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.105890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.106171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.106490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.115496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.118779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.133920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 383/779] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:39.135306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.145969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950b8d1-bea2-439e-a457-9780cf5e3ce1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.150815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.151600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.151878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.152201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.163012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.165005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.184221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:39.189478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 397/780] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:39.192945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.202850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9b958-dcea-4817-a801-df90ef1b0f17 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.207624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.208789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.209067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.209426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.210360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:39.210699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.212601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45cf05-1e29-4dbb-84d0-56660e1beedd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.230658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 384/781] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:39.232061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.239667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ea7f-79c6-4f04-882d-330a8c01f35e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.239954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ea7f-79c6-4f04-882d-330a8c01f35e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.240234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26ea7f-79c6-4f04-882d-330a8c01f35e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.242226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 385/782] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:39.243041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21e97b-215b-44ca-b950-81ec5a77383b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.247869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.248117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.248400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.250310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.251223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.251605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.251877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.259270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.261263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.266629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:39.267925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:39.275170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:39.285982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 398/783] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:39.286232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 386/784] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:39 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:39.286411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.293591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadffe8-502e-49e9-b6e3-9ca0e45021e9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.298359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.299159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.299444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.299777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.300563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:39.300928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.303312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.303812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.312547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069d2a2-6ebd-41c0-baca-276fc60e8031 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.316288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 399/785] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:39.322791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.323194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.323870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.324155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.324427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.325185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.326221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:39.326221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:58:39.326221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:58:39.327155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6b894-f5ed-4118-b7f4-fb2f0681ccef admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.333898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9e94a-3d6f-4645-ae23-830a2f36c548 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.338859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.339530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.339897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.340209 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.341020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] RBAC: Adding query filter params (role.id=86a6457b304a4886a2fb7aba61842f67, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=390faf536fad46aca3a8a433da441e7d) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:39.341329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.343321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34855bda-9a5b-4169-afbc-e05a771e1484 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.350152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 400/786] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/role_assignments?user.id=390faf536fad46aca3a8a433da441e7d&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=86a6457b304a4886a2fb7aba61842f67 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:39.396088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 387/787] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:39 2021] POST /identity/v3/services => generated 251 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:39.402603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d48a4-ca4d-4e7b-acd2-631fdf665a52 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.402603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d48a4-ca4d-4e7b-acd2-631fdf665a52 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.402603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d48a4-ca4d-4e7b-acd2-631fdf665a52 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.402603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 401/788] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:39.416805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.417135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.417358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.438674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:39.440108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:39.460129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 388/789] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:39 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:39.484561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d48a4-ca4d-4e7b-acd2-631fdf665a52 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.498065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d48a4-ca4d-4e7b-acd2-631fdf665a52 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.509016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.510272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.510790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.511299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.512200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.514169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.533276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 04:58:39.535363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 402/790] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/services/object-store => generated 93 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:39.542525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.552476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f753176-6257-47ef-ac68-13550fcb1688 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.557281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.557959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.558237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.558510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.559289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:39.559582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.561235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fdbe3-8c55-4ed4-9f57-aac0a03a56c2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.572590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 389/791] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:39.574099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:39.584656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec14d6-361a-4b95-8fd1-424ed0096db4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:39.589562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:39.590219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:39.590498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:39.590814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:39.591519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:39.591819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:39.593399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57397-3ce9-479d-b0da-877649064506 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:39.599772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 403/792] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:39 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:40.103866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6922-559a-449b-8c5f-4523ba79ec91 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.104379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6922-559a-449b-8c5f-4523ba79ec91 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.104483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda6922-559a-449b-8c5f-4523ba79ec91 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.106418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 390/793] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:40.112405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.112789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.112960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.131164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:40.132355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:40.140239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 404/794] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:40 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:40.165076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda6922-559a-449b-8c5f-4523ba79ec91 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:40.177586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda6922-559a-449b-8c5f-4523ba79ec91 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:40.182247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:40.183075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.183361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.183636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.184280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:40.185870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:40.197368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 04:58:40.198866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 391/795] 10.222.0.16 () {56 vars in 1154 bytes} [Tue Aug 10 04:58:40 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:40.205249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:40.215255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189a941-295b-4bec-bc68-fa9da1345cd6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:40.222639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:40.222639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.222639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.222639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.222952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:40.222952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:40.223854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:40.229154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 405/796] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:40 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:40.235397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:40.245924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d66acf-b26f-456c-ad72-13e7024a2dbc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:40.250639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:40.251302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.251585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.251858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.252561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:40.252866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:40.254517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:40.260070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 392/797] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:40 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:40.266524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:40.277042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8363f46-d215-48e0-9d54-f15c8c9ee08c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:40.281776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:40.282426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.282741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.283016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.283802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] RBAC: Adding query filter params (interface=public, service_id=e6a7fb85faa94a64b025595c6a774787, region_id=RegionOne) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:40.284110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:40.285757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec867b7e-e34c-4f85-a609-89329bc53ed0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:40.291705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 406/798] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:40 2021] GET /identity/v3/endpoints?service_id=e6a7fb85faa94a64b025595c6a774787&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:40.297744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:40.312613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb870e1-a190-49a8-afcf-56112c49ace6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:40.317691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc374969-6697-4df5-b305-763db0f084f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:40.318638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374969-6697-4df5-b305-763db0f084f0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:40.319149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374969-6697-4df5-b305-763db0f084f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:40.319601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc374969-6697-4df5-b305-763db0f084f0 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:40.320523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374969-6697-4df5-b305-763db0f084f0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:40.322568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc374969-6697-4df5-b305-763db0f084f0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:40.329049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 393/799] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:40 2021] GET /identity/v3/services => generated 1268 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 04:58:41.514144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d6ea-2929-4b56-8d8e-dfb90813caec None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.514680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d6ea-2929-4b56-8d8e-dfb90813caec None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.514795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3d6ea-2929-4b56-8d8e-dfb90813caec None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.516737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 407/800] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:41.523407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2fa6-cdab-4a1d-9ca2-43a5dac3e857 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.523786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2fa6-cdab-4a1d-9ca2-43a5dac3e857 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.523981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f2fa6-cdab-4a1d-9ca2-43a5dac3e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.543417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8b9f2fa6-cdab-4a1d-9ca2-43a5dac3e857 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:41.544670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8b9f2fa6-cdab-4a1d-9ca2-43a5dac3e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:41.553224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 394/801] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:41 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:41.576814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d6ea-2929-4b56-8d8e-dfb90813caec None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.590053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3d6ea-2929-4b56-8d8e-dfb90813caec None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.594545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.595369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.595650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.595919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.607039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:41.609153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff536-d924-452b-b869-e1106da93f0b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.609447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff536-d924-452b-b869-e1106da93f0b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.609725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ff536-d924-452b-b869-e1106da93f0b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.611780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 395/802] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:41.614748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 04:58:41.616239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 408/803] 10.222.0.16 () {56 vars in 1142 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:41.617692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.618204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.618743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.622694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.632957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c20336-72a6-4f73-81dd-e4e765d28c95 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.637591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.638274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.638637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.638922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.639657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.639963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.640246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:41.641545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.641848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:41.653094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 409/804] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:41.654233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 396/805] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:41 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:41.659565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.670484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16f98f-cc97-4148-bc34-8c61e704021b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.675362 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.676188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.676517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.676792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.683812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.688438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.690394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.696441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8988a62-8469-44f2-8ac8-348c39a481bc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.702517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.703588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.704092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.704579 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.705436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.707272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.708832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:41.710314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 410/806] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:41.716620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.720456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-8b6ae153-86af-4d46-a796-34362ce202b1 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 04:58:41.722376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 397/807] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:41.727273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d037dd-4352-4868-a681-da07cbfa0c22 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.727562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d037dd-4352-4868-a681-da07cbfa0c22 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.727852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d037dd-4352-4868-a681-da07cbfa0c22 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.729659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 398/808] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:41.730221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d037dd-4352-4868-a681-da07cbfa0c22 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.731200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681ca0-c3f6-4b50-baf6-8597428ce148 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.735765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.736476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.736770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.737026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.737929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.738326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.740504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725a091-9b2a-44b0-a61e-d807b11cbeae admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.746844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d037dd-4352-4868-a681-da07cbfa0c22 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.751218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.751828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.752108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.752376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.753064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.753366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.754724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 411/809] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:41.755072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.756969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.757490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.757976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.759912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 399/810] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:41.760787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.771910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab169e7-c32e-4e1c-9249-f9ae793136d3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.776628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.777427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.777707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.777974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.778822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:41.780147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:41.786771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.788790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.789745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 412/811] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:41 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:41.794890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.799692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd11cb-624c-4ecf-a537-7c5a2b308f54 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.804680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.805311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.805592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.805864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.806563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.806892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.808527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.810277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 04:58:41.812009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 400/812] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:41.814012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 413/813] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:41.819883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.820913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.830156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2d632-28a2-4db8-81e3-9c3a0a700cfc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.830971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b29363-8524-48d9-8529-fb09ae810ee6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.834847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.835565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.835682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.835851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.836102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.836596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.836943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.837076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.837343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.838226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.838618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.838806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.840437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.862759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 414/814] 10.222.0.16 () {56 vars in 1171 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:41.862759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.872071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30446830-9194-497d-81fa-5a7c9ec9257c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.876382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.876991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.877268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.877534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.878296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] RBAC: Adding query filter params (interface=public, service_id=417c171ab76641fc885164704645e736, region_id=RegionOne) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.878713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.880259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.885153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 415/815] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/endpoints?service_id=417c171ab76641fc885164704645e736&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:41.885916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.895090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85f8c8-7155-4272-9a31-83746da909bb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.899451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.900201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.900483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.900759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.911472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 401/816] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:41 2021] POST /identity/v3/services => generated 241 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:41.911633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.912571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.913515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.942135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:41.943857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 416/817] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:41.949410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7dcc7-b149-4dd0-bb74-fc8c56db7a19 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.950438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:41.954389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.955134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.955420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.955715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.956393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.958321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.963263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a7678-67d4-434b-a634-5df8e09b41fd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:41.966523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 402/818] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/services => generated 1497 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 04:58:41.968760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:41.969450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:41.969733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:41.970006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:41.970787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:41.971094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:41.972731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:41.992527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 417/819] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:41.999177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.010346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844eb857-cb72-4087-9ce4-06177d274568 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.015412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.016286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.016569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.016840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.025649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.027926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.044236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:42.045922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 403/820] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:41 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:42.054716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.067338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cade8-0265-46ce-8b6e-dd9884399b8a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.072694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.073664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.074079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.074542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.075535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:42.075974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.078174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f1618-9be3-4a78-9fd3-bd1c7ffdf2f6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.094236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 418/821] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:42.101354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.112736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1e4f-89f8-4501-9efc-fcc16b244213 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.118261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612d2cb-9610-48e5-9cd9-1e8169f68ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.119565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612d2cb-9610-48e5-9cd9-1e8169f68ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.120005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612d2cb-9610-48e5-9cd9-1e8169f68ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.120463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612d2cb-9610-48e5-9cd9-1e8169f68ec4 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/390faf536fad46aca3a8a433da441e7d/roles/86a6457b304a4886a2fb7aba61842f67` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.123233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612d2cb-9610-48e5-9cd9-1e8169f68ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=390faf536fad46aca3a8a433da441e7d, role_id=86a6457b304a4886a2fb7aba61842f67)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.126302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612d2cb-9610-48e5-9cd9-1e8169f68ec4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.199593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 404/822] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:42 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/390faf536fad46aca3a8a433da441e7d/roles/86a6457b304a4886a2fb7aba61842f67 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:42.502393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310482c-c80a-44a4-80e7-9421cac88df9 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.502712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310482c-c80a-44a4-80e7-9421cac88df9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.502987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310482c-c80a-44a4-80e7-9421cac88df9 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.505051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 419/823] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:42.510886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.511183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.511462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.534564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:42.535841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:42.592778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 405/824] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:42 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:42.616524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310482c-c80a-44a4-80e7-9421cac88df9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.629012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310482c-c80a-44a4-80e7-9421cac88df9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.633953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.634781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.635063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.635336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.635989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.637586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.648808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 10 04:58:42.650213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 420/825] 10.222.0.16 () {56 vars in 1154 bytes} [Tue Aug 10 04:58:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:42.656509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.666121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109db37-cc1f-4ad4-b597-dad482ea98cd None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.670863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.671525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.671802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.672127 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.672833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:42.673184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.674829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.680297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 406/826] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:42.686097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.696515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef3f9d-9eba-4982-8073-adfb9ede9fa7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.701136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.701791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.702074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.702349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.703080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:42.703388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.704983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aaf774-fe92-445b-883d-f241b63ce10b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.710690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 421/827] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:42 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:42.717211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:42.727574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a629d3-99c1-4622-8e50-0e04a5054c13 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:42.732533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350012b8-e901-4a16-aa4d-6a78dc5f100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:42.733239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350012b8-e901-4a16-aa4d-6a78dc5f100b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:42.733662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350012b8-e901-4a16-aa4d-6a78dc5f100b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:42.734038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350012b8-e901-4a16-aa4d-6a78dc5f100b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:42.734863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350012b8-e901-4a16-aa4d-6a78dc5f100b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:42.736699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350012b8-e901-4a16-aa4d-6a78dc5f100b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:42.834752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 407/828] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:42 2021] POST /identity/v3/endpoints => generated 347 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:44.152248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e279-124a-4d0f-a35a-3d009e8371d8 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.152771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e279-124a-4d0f-a35a-3d009e8371d8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.152848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9e279-124a-4d0f-a35a-3d009e8371d8 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.154881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 422/829] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:44.158890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820440-7f2b-45e4-bd4b-6986a5430503 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.160530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.161342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.161615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.162814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820440-7f2b-45e4-bd4b-6986a5430503 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.163199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820440-7f2b-45e4-bd4b-6986a5430503 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.165286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 408/830] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:44 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:44.171975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.172261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.172537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.187574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:44.188747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:44.191367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:44.192878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:44.206593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 423/831] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:44 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:44.218777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 409/832] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:44 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:44.230886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.240508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f784195-d60a-46fb-859a-a0918988ce8d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.240653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.245278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.246075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.246356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.246655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.247320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.248925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.251354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c96f37-d5fb-4e7b-94bc-fe93e4865b30 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.257310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.258104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.258384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.258677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.259330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.260431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 10 04:58:44.260904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.261876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 424/833] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:44.268168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.272960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 04:58:44.278707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 410/834] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:44.282731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.283881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7857e-84c1-4592-a1e8-496e4b901b62 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.289428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.290181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.290479 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.290798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.291524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.291832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.293481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.294559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b5bad-9d66-46b0-b717-4fe79ee144d8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.299269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 425/835] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.300463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.301158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.301502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.301777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.302500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.302830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.304469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.305934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.314696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 411/836] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:44.318331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.321471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00953f4f-9492-41a4-897a-cb827ea7f39c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.326496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.327287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.327668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.328040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.328757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2feda-d6e4-4a63-8d9b-6c20f3a508c9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.328927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.329333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.331081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.333948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.334904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.335184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.335454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.336151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.336713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.337472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 426/837] 10.222.0.16 () {56 vars in 1136 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:44.338362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524ed992-dec5-4876-b2f0-61dd8cca64d8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.343533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.345624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 412/838] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.347035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb19ba-9818-4eb7-9369-cb05494b59dc None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.347319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb19ba-9818-4eb7-9369-cb05494b59dc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.347587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb19ba-9818-4eb7-9369-cb05494b59dc None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.350518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 413/839] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:44.353542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb19ba-9818-4eb7-9369-cb05494b59dc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.356484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14317434-8756-407b-8ed6-33e143807c4b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.361079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.361731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.362014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.362288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.363051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.364117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:58:44.364117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:58:44.364117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:58:44.364989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.368260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb19ba-9818-4eb7-9369-cb05494b59dc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.372674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.373301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.373578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.373847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.374645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] RBAC: Adding query filter params (interface=public, service_id=cb8f16e01fe344098f40a54c3200919a, region_id=RegionOne) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.375054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.376513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3d259-9b69-427d-9fe8-1a5394ec2554 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.386961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 414/840] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/endpoints?service_id=cb8f16e01fe344098f40a54c3200919a&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.386961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.386961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.386961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.400897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:44.402059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:44.409743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 415/841] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:44 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:44.410421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.419675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc13b6d-3e84-4e90-9878-4b8506a91e79 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.424113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.424743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.425021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.425289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.425954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.427585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.433626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 416/842] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/services => generated 1497 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 04:58:44.434428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.445109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a4209-b330-444c-9961-b031671b2408 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.450163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.451085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.451376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.451616 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.462643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 427/843] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:44 2021] POST /identity/v3/endpoints => generated 346 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:44.473511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:44.481343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 04:58:44.482890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 417/844] 10.222.0.16 () {56 vars in 1142 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:44.490236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.511874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b07cf3-49b4-46c3-8a49-a7ce86b42ca5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.516760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.522750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.523037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.523314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.524097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.524405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.526130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.541701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 428/845] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.548294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.559873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279182b-e0c8-4213-a907-8b26ead618ce admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.564792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.565616 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.565896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.566170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.578890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.580798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.599651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:44.601287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 418/846] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:44.607780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.618880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42366bbd-7e80-4fff-b3d7-b543625920c7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.627044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.627728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.628006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.628278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.629006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.629309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.631575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.646052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 429/847] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.653019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.663155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c74a01-83fa-4e53-af97-a8da371543cf admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.668256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.669307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.669729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.670191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.679708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.681731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.698119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 10 04:58:44.699671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 419/848] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:44.705856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.716871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f40e2-0c4f-42a6-847f-ca376466f416 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.723816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.724744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.725168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.725595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.726685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.727183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.729240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.748729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 430/849] 10.222.0.16 () {56 vars in 1171 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.755207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.765055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035189-3060-4ce5-8c91-68bd5fd8fef8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.770508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.771396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.771865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.772278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.780693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.782774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.792365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 420/850] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/auth/tokens => generated 2291 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:44.798740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.809263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16cbbe-3062-457b-bd08-5efda670dad1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.814118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.815201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.815718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.816152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.827065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.829134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.846396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:44.848685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 431/851] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:44.855004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.864126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532690b-da4f-4f21-a08e-3ed35c041536 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.868911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.869778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.870240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.870679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.871543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.872033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.873759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.886233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 421/852] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.892431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.902406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc206a-7108-4b32-ae21-195a0a3a3001 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.907343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.908305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.908756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.909166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.916928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.919123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.932088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:44.933724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 432/853] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:44.940395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.952231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee009660-459f-457c-b0d3-7b4fced53bbe admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:44.957857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:44.958887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:44.959310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:44.959753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:44.960760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:44.961218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:44.963706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc7071-304a-4a56-a9b9-0df986d3332e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:44.978458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 422/854] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:44.985237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:44.996217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f0177-1e03-449f-aaf2-8462d3d1328d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:45.001203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:45.007966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:45.007966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:45.007966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:45.007966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] RBAC: Adding query filter params (role.id=86a6457b304a4886a2fb7aba61842f67, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=390faf536fad46aca3a8a433da441e7d) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:45.007966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:45.008380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2a7c9-fe8e-4244-8a75-ca72dbd2ff83 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:45.011069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed596-a811-409c-920d-a26b208ee03f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:45.011359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed596-a811-409c-920d-a26b208ee03f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:45.011638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeed596-a811-409c-920d-a26b208ee03f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:45.012588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 433/855] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:44 2021] GET /identity/v3/role_assignments?user.id=390faf536fad46aca3a8a433da441e7d&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=86a6457b304a4886a2fb7aba61842f67 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:45.013613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 423/856] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:45.019667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:45.019951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:45.020281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:45.040127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:45.041550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:45.053765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 434/857] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:45 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:45.076545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed596-a811-409c-920d-a26b208ee03f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:45.090824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeed596-a811-409c-920d-a26b208ee03f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:45.095927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:45.096962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:45.097344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:45.097762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:45.099126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:45.100992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:45.113291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 04:58:45.115024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 424/858] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:45 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:45.121730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:45.132368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b768c1f-0ed9-48ee-bf86-2b2992de2e6d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:45.138043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:45.138323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:45.138723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:45.139099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:45.139967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:45.140361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:45.142147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c66947-837c-40e8-afa3-730b36b566d1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:45.148099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 435/859] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:45 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:45.154479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:45.165415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2936a1-b498-4699-a50c-f9d8df022ee4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:45.171667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:45.172436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:45.172865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:45.173270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:45.174087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:45.174523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:45.176448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898c91c-23a4-4f99-974f-8ee77ddac9b4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:45.181937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 425/860] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:45 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:46.662717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7a50-d2ae-4de8-96a4-34f7332af94b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.662717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7a50-d2ae-4de8-96a4-34f7332af94b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.662717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b7a50-d2ae-4de8-96a4-34f7332af94b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.663881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 436/861] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:46.670626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.671442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.671976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.690213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:46.691711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:46.698013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c10e1-1989-4336-8418-b7bb4300da8b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.698306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c10e1-1989-4336-8418-b7bb4300da8b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.698639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c10e1-1989-4336-8418-b7bb4300da8b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.700592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 437/862] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:46.704907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 426/863] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:46 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:46.706082 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.706370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.706691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.724898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:46.726097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:46.728009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.737377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc453a4-4ea1-4e83-ae72-9f05f158834e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.740312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 438/864] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:46 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:46.749190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.750273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.750793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.751276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.752199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.754032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.764771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.767063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 04:58:46.774208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4100d0f1-ff13-400d-8036-ba753c892442 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.774477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 427/865] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:46.776143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.779129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.779968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.780252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.780521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.781219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.783126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.784545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.common [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 10 04:58:46.788225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad098b1-fd0a-4a1a-9f8a-84078c95d469 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.793033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.793950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.794438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.794955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.795874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:46.796405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.798191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.803989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 428/866] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:46.810334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.820430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d2402-5156-4233-bb3d-2b132a7a1b05 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.825046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.825678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.825959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.826232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.826971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:46.827279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.828911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.834157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 429/867] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:46.838248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.sql.core [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 10 04:58:46.838248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 10 04:58:46.838248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [parameters: {'id': 'ceef659a5bb744149593b6697375cbdd', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 10 04:58:46.838248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 04:58:46.840773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.850884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d3504-b2fb-4c91-8b87-c69c263080ab admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.855537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adce53-a48d-43c8-8aa3-43d0bd09d784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.856193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adce53-a48d-43c8-8aa3-43d0bd09d784 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.856479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adce53-a48d-43c8-8aa3-43d0bd09d784 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.856834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adce53-a48d-43c8-8aa3-43d0bd09d784 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.857577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adce53-a48d-43c8-8aa3-43d0bd09d784 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.858473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ceef659a5bb744149593b6697375cbdd.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ceef659a5bb744149593b6697375cbdd. Aug 10 04:58:46.859292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0adce53-a48d-43c8-8aa3-43d0bd09d784 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.860751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 439/868] 10.222.0.16 () {60 vars in 1162 bytes} [Tue Aug 10 04:58:46 2021] POST /identity/v3/projects => generated 262 bytes in 96 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:46.868291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.880310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7f05-f228-468e-aaa9-d96ddf06ce37 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.884960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.885738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.886017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.886286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.893331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.896122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.908854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:46.912418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 440/869] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:46.916857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:46.927080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701b6dc9-1e05-4a59-8612-8460218a47e6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:46.931543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:46.939658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:46.939658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:46.939658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:46.939658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:46.939658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:46.939658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2677d-0afe-465b-a44f-74ec0e79297f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:46.945216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 430/870] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:46 2021] POST /identity/v3/endpoints => generated 349 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:46.960151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 441/871] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:46 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:47.205749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953969f-0314-4eef-bcec-dfd801b029ee None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.206096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953969f-0314-4eef-bcec-dfd801b029ee None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.206290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2953969f-0314-4eef-bcec-dfd801b029ee None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.208348 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 431/872] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:47.214846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.215144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.215421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.235748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:47.237621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:47.256360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 442/873] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:47 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:47.280872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953969f-0314-4eef-bcec-dfd801b029ee None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:47.298375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2953969f-0314-4eef-bcec-dfd801b029ee None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:47.302955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:47.303830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.304120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.304446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.305104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:47.306730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:47.318783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-2b102716-73e8-4155-96d8-39c76b2101a1 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 04:58:47.320403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 432/874] 10.222.0.16 () {56 vars in 1127 bytes} [Tue Aug 10 04:58:47 2021] GET /identity/v3/services/image => generated 86 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:47.326793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:47.334882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d9353-7858-4916-9748-03cce2aae268 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.335171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d9353-7858-4916-9748-03cce2aae268 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.335446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d9353-7858-4916-9748-03cce2aae268 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.337798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2957ce-d0bf-40b8-ac3d-b46c2d18ffe7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:47.337908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 433/875] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:47.342718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:47.343627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.343750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.344022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.344300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.344638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.345099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.346201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:47.346784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:47.348771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:47.354639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 443/876] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:47 2021] GET /identity/v3/services?name=image => generated 122 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:47.360927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:47.363626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:47.364936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:47.372700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797516d-03b0-403c-890a-b09cd5600220 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:47.377652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:47.378720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 434/877] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:47 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:47.378935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.380033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.380556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.381463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] RBAC: Adding query filter params (type=image) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:47.382008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:47.383882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f86ee-4dc2-4c11-96f8-8931b86e1655 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:47.389577 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 444/878] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:47 2021] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:47.398680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:47.408528 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3edae1-a6b3-4174-980f-1d97b6f68254 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:47.413983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afe9eb-4e00-46ce-ad6e-46eca6a38e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:47.414744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe9eb-4e00-46ce-ad6e-46eca6a38e2c admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:47.415026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe9eb-4e00-46ce-ad6e-46eca6a38e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:47.415302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afe9eb-4e00-46ce-ad6e-46eca6a38e2c admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:47.416053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afe9eb-4e00-46ce-ad6e-46eca6a38e2c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:47.417696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afe9eb-4e00-46ce-ad6e-46eca6a38e2c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:47.529806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 435/879] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:47 2021] POST /identity/v3/services => generated 242 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:49.178619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0da1-d919-405d-a732-1fb87e41d53d None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.179140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0da1-d919-405d-a732-1fb87e41d53d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.179217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c0da1-d919-405d-a732-1fb87e41d53d None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.180938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 445/880] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:49.182267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ebdd-e60a-46f9-b134-422a71c90e32 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.182712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ebdd-e60a-46f9-b134-422a71c90e32 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.182913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ebdd-e60a-46f9-b134-422a71c90e32 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.184732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 436/881] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:49.186668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.186953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.187225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.191580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.192695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.193331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.207790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:49.208980 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:49.217090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:49.219190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:49.226426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 446/882] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:49 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:49.232887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 437/883] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:49 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:49.252527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.258333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.266111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b6ce4-d6a6-43eb-9899-80b500d5d2b6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.271390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e5ca1-f947-4782-88e7-50472f864eb8 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.271503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.271971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.272254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.272539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.273242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.274510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.275248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.275758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.276239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.276719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.277661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.279470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.291561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 04:58:49.292932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 438/884] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:49.299850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.310014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8ddab-fdae-48f0-a2a6-6f66c360b3bb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.314518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.315065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.315426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.315655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.316293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.316595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.317180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.sql.core [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 10 04:58:49.317180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 10 04:58:49.317180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [parameters: {'user_id': '14f6c106cde54a4ea9653ae5c4a2dfda', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 10 04:58:49.317180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=73231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 10 04:58:49.318767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.329012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 439/885] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:49.329147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 10 04:58:49.329147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 447/886] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 04:58:49 2021] POST /identity/v3/users => generated 160 bytes in 76 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:49.330537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.335162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.345064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b2f03-c6c6-4563-9fdb-d09d6522ca6f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.346071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fc91d-5f9a-4993-bdfe-9f59d030cd92 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.351116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.351275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.352005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.352117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.352371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.352517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.352644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.352958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.354014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.354408 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.356284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.360448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.362401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 440/887] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:49.362709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.370283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.380491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae5f98-857a-4f02-84ea-1a82c7c20ffd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.381101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 10 04:58:49.382431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 448/888] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:49.388665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.390379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.391319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.391856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.392332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.393591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] RBAC: Adding query filter params (interface=admin, service_id=cb8f16e01fe344098f40a54c3200919a, region_id=RegionOne) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.394109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.396864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.398208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787e9d7-91be-4a1b-b155-232a2c93c051 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.402977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.403646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.403893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.408918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.408918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.408918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.408918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ad1c7-a878-4c23-a478-0b575cf137e4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.409552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 441/889] 10.222.0.16 () {56 vars in 1271 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/endpoints?service_id=cb8f16e01fe344098f40a54c3200919a&interface=admin®ion_id=RegionOne => generated 193 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:49.411868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.425362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cefb05-6d8d-4781-81de-2d988e835b89 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.430526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a80fa-ba97-410a-9116-72be6c441b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.431458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a80fa-ba97-410a-9116-72be6c441b8d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.432023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a80fa-ba97-410a-9116-72be6c441b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.432517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a80fa-ba97-410a-9116-72be6c441b8d admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.434394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a80fa-ba97-410a-9116-72be6c441b8d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.436230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a80fa-ba97-410a-9116-72be6c441b8d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.450817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 442/890] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services => generated 1727 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 04:58:49.456657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 449/891] 10.222.0.16 () {56 vars in 1123 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:49.566682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8006-0090-472a-95f8-2cfbc9d08544 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.567014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8006-0090-472a-95f8-2cfbc9d08544 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.567295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8006-0090-472a-95f8-2cfbc9d08544 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.569464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 443/892] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:49.576249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3bbbd-98c9-48bc-8b86-7df06d4d9137 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.576538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3bbbd-98c9-48bc-8b86-7df06d4d9137 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.576818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3bbbd-98c9-48bc-8b86-7df06d4d9137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.596858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b1b3bbbd-98c9-48bc-8b86-7df06d4d9137 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:49.599087 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b1b3bbbd-98c9-48bc-8b86-7df06d4d9137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:49.607815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 450/893] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:49 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:49.632791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8006-0090-472a-95f8-2cfbc9d08544 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.648381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff8006-0090-472a-95f8-2cfbc9d08544 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.654332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.655142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.655425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.655695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.656452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.658102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.724281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441dc09-30f5-47e1-83d9-4f6bd945e139 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.724492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441dc09-30f5-47e1-83d9-4f6bd945e139 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.724771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441dc09-30f5-47e1-83d9-4f6bd945e139 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.726631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 451/894] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:49.728162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 444/895] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:49 2021] POST /identity/v3/services => generated 242 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:49.732739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.733019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.743800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.753512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:49.754892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:49.774555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 452/896] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:49 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:49.799379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.810008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffba8fd-9aa3-4742-8576-f4157d79f6da admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.814609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.815475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.815756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.816020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.816704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.818355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.829895 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 04:58:49.831175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 445/897] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:49.838766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.847968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962538b-7000-42e7-a4b2-34ed40698be2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.853163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.853871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.854153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.854428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.855186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.855493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.857147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.862788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 453/898] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:49.869314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.880452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86b2d0-e5da-4be8-b2eb-2d4f5665da40 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.885447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.886252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.886669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.887046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.887876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.888286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.890346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.896269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 446/899] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:49.902478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.914317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73604f-7daa-4cd3-b75b-5a359bced6fb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.919099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.919856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.920153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.920433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.921212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] RBAC: Adding query filter params (interface=public, service_id=75d4b8be21b54661a5a5c541df9fb3c7, region_id=RegionOne) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:49.921527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.923153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961704d-f460-4eb2-9bc1-745eb63cfad2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.928669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 454/900] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/endpoints?service_id=75d4b8be21b54661a5a5c541df9fb3c7&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:49.935033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:49.945024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd255a-285c-41f6-b827-bebdbc755591 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:49.949692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce40dfd-c68d-47ef-a6e4-12f9070b6b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:49.950353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce40dfd-c68d-47ef-a6e4-12f9070b6b35 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:49.950666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce40dfd-c68d-47ef-a6e4-12f9070b6b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:49.950945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce40dfd-c68d-47ef-a6e4-12f9070b6b35 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:49.951685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce40dfd-c68d-47ef-a6e4-12f9070b6b35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:49.953257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce40dfd-c68d-47ef-a6e4-12f9070b6b35 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:49.960882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 447/901] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:49 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 04:58:51.636920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6451-57bb-4b41-a2c7-2550f3f86a3d None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.637448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6451-57bb-4b41-a2c7-2550f3f86a3d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.637522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b6451-57bb-4b41-a2c7-2550f3f86a3d None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.639427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 455/902] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:51.645226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.645642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.645802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.663719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:51.664912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:51.672871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 448/903] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:51 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:51.697628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6451-57bb-4b41-a2c7-2550f3f86a3d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:51.710598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b6451-57bb-4b41-a2c7-2550f3f86a3d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:51.715378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:51.716173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.716455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.716731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.717386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:51.719017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:51.732452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 10 04:58:51.733794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 456/904] 10.222.0.16 () {56 vars in 1148 bytes} [Tue Aug 10 04:58:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:51.740756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:51.749860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8f502-f154-41f0-baa9-ace5cb93b5c5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:51.754640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:51.755304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.755588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.755859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.756562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:51.756868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:51.758460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:51.763546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 449/905] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:51.769608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:51.779385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e090b2-8bfe-4f51-93e3-714da190bbc3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:51.783961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:51.784613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.784900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.785176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.786401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:51.786749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:51.788332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1f9e1-a409-431f-8650-555f163cc128 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:51.793325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 457/906] 10.222.0.16 () {56 vars in 1144 bytes} [Tue Aug 10 04:58:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:51.799697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:51.809812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa612cc2-afed-4afb-9c45-493114f68b35 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:51.814426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:51.815237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.815584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.815926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.816764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:51.818506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:51.881828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fede6-9fd1-400a-9442-980dde882ea5 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.882121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fede6-9fd1-400a-9442-980dde882ea5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.882403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fede6-9fd1-400a-9442-980dde882ea5 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.884224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 458/907] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:51.889726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.890013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.890292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.906839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 450/908] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:51 2021] POST /identity/v3/endpoints => generated 325 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:51.908448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:51.909670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:51.929762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 459/909] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:51 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:51.953617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:51.965195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac5f9d-ee2e-445c-bc14-a298c7b52830 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:51.969939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:51.970851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:51.971119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:51.971392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:51.972054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:51.974242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:51.985828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 04:58:51.987324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 451/910] 10.222.0.16 () {56 vars in 1127 bytes} [Tue Aug 10 04:58:51 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:51.993845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.003173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217732-436e-43ed-ab5d-dcd6bd69eab9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.008027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.008769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.009052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.009326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.010058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] RBAC: Adding query filter params (name=image) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:52.010366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.012100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.018107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 460/911] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:51 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:52.025314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.036402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f76c28-3d03-4bf7-a887-54f24db627f9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.041483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.042237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.042524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.042833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.043626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] RBAC: Adding query filter params (type=image) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:52.043942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.045677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.052440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 452/912] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:52 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:52.058933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.069422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b99064-4c7e-4aa7-b820-be7f4efd330e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.074026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.074699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.074977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.075248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.076074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] RBAC: Adding query filter params (interface=public, service_id=afaa6ae7b92e4de3b82f73b318b65532, region_id=RegionOne) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:52.076356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.077911 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4bc7a-9e88-4f2d-8197-8e1b89dea450 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.083740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 461/913] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 04:58:52 2021] GET /identity/v3/endpoints?service_id=afaa6ae7b92e4de3b82f73b318b65532&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:52.090374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.092304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bee86-75e0-4057-bae5-b5ebc0c84798 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.092579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bee86-75e0-4057-bae5-b5ebc0c84798 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.092907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bee86-75e0-4057-bae5-b5ebc0c84798 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.094995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 462/914] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:52.100478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bca9a-ebd5-49d7-9999-d14c8612aacf admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.102322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.102630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.102906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.105717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.106394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.106704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.106984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.107679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.109506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.118814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 453/915] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 04:58:52 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 04:58:52.121051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:52.122275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:52.134673 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 463/916] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:52 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:52.156332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.167043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7c1a1-fac2-47a7-aa64-cd10208c04c0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.171838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.172664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.172951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.173232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.173906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.175597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.187539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 10 04:58:52.188814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 454/917] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:52 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:52.195642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.205069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d506d-e544-4c67-a4ae-e803ee7c454f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.210633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.211317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.211604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.212137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.214750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] RBAC: Adding query filter params (name=compute) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:52.214750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.215029 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.220540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 464/918] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:52 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:52.226911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.237839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647ed91-9b6c-4e2a-9c7d-de888fec2cb4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.243684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.244433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.244719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.245160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.245715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:52.246022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.247676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df57275-44a1-442c-89f0-abf605b836f4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.253576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 455/919] 10.222.0.16 () {56 vars in 1134 bytes} [Tue Aug 10 04:58:52 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:52.268518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:52.278491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7604e3a-3be0-4aee-b9fa-9610c86f56ac admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:52.283351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7bf51-41a4-4be3-927b-22ae8f54cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:52.284007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7bf51-41a4-4be3-927b-22ae8f54cd9a admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:52.284290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7bf51-41a4-4be3-927b-22ae8f54cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:52.284561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7bf51-41a4-4be3-927b-22ae8f54cd9a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:52.285308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7bf51-41a4-4be3-927b-22ae8f54cd9a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:52.286999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7bf51-41a4-4be3-927b-22ae8f54cd9a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:52.419212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 465/920] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:52 2021] POST /identity/v3/endpoints => generated 334 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:54.044065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375043c6-b5b3-49b4-ac55-538a2af111e6 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.044609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375043c6-b5b3-49b4-ac55-538a2af111e6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.044609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375043c6-b5b3-49b4-ac55-538a2af111e6 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.046518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 456/921] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:54.052553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.052981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.053150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.070912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:54.072088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:54.094601 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 466/922] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:54 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:54.114203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375043c6-b5b3-49b4-ac55-538a2af111e6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.126182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375043c6-b5b3-49b4-ac55-538a2af111e6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.131034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261a245-86ae-472b-b21b-b4d466687690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.131811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a245-86ae-472b-b21b-b4d466687690 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.132094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a245-86ae-472b-b21b-b4d466687690 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.132367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261a245-86ae-472b-b21b-b4d466687690 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.133528 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a245-86ae-472b-b21b-b4d466687690 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.135233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261a245-86ae-472b-b21b-b4d466687690 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.136938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 457/923] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:54.143102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.152852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41999cfc-575f-4186-9887-84b0eaae34f4 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.157478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.158152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.158432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.158741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.159471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.161466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.229168 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fe242-afa1-43de-a8f6-ded1dd755250 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.229449 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fe242-afa1-43de-a8f6-ded1dd755250 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.229718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281fe242-afa1-43de-a8f6-ded1dd755250 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.231510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 458/924] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 04:58:54.237000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.237283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.237558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.256492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:54.257709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:54.265387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 459/925] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:54 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 04:58:54.289236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.298165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f6dc0-45c5-4ccf-99e5-d1ac7d9c9602 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.303146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.303913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.304190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.304458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] PATH_INFO: `/v3/services/image` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.305104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.306696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.317143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 10 04:58:54.318281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 460/926] 10.222.0.16 () {56 vars in 1127 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/services/image => generated 86 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:54.323137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 467/927] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:58:54 2021] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:54.324673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.335373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da248d80-e7d7-4fff-84d6-085bfda2cd13 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.395614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.396338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.396680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.396954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.397666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:54.397969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.399659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.405258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 461/928] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/services?name=image => generated 122 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:54.412383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.422791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288eec5d-647f-4918-ba89-377a8c49fd9f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.427844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.428627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.428977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.429315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.430095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] RBAC: Adding query filter params (type=image) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:54.430466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.432196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4599b1d-159a-4425-a95a-aad9b0d509be admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.438004 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 468/929] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/services?type=image => generated 350 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:54.444763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.455013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca5fd24-e62e-499a-8a73-cce1a7dbd9d0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.460532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbeca5a-faa0-45bc-ac73-4ea283e87f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.461204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeca5a-faa0-45bc-ac73-4ea283e87f4f admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.461530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeca5a-faa0-45bc-ac73-4ea283e87f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.461807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbeca5a-faa0-45bc-ac73-4ea283e87f4f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.462879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeca5a-faa0-45bc-ac73-4ea283e87f4f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.464564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbeca5a-faa0-45bc-ac73-4ea283e87f4f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.544945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 462/930] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 04:58:54 2021] POST /identity/v3/endpoints => generated 327 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:58:54.625485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745ee8c-dd6f-4470-a4c6-40a575237d67 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.625807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745ee8c-dd6f-4470-a4c6-40a575237d67 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.625975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745ee8c-dd6f-4470-a4c6-40a575237d67 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.627982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 469/931] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:54.634655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.635205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.635483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.656027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:54.657273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:54.700309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 463/932] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:54.726519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745ee8c-dd6f-4470-a4c6-40a575237d67 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.740937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745ee8c-dd6f-4470-a4c6-40a575237d67 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.746989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.747809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.748094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.748379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.764337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:54.771681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 04:58:54.773086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 470/933] 10.222.0.16 () {56 vars in 1142 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:54.780097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.789387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839fbd7-f4d7-4703-84aa-fdbe14cb759d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.794170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.794972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.795324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.795671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.796588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:54.796801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.798470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.808303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 464/934] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:54.814360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.825555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de83db7-90b3-4853-bd56-5a97df95005e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.830287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.831123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.831406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.831680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.842497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.844382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.861217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:54.862715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 471/935] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:54.869014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.880573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd23b49-fb28-4ce9-9f9a-c5866558cce1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.885233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.885980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.886340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.886719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.887514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:54.887896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.889557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.902086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 465/936] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:54.908568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.919258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758515b-2786-41fc-9c3b-c4e06fed46e8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.924208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.925098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.925441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.925811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.933714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.935905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:54.950533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:54.952021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 472/937] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:54.958637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:54.968845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de740e8-c868-4077-be3c-c5058288c3ae admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:54.973562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:54.974232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:54.974519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:54.974834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:54.975674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:54.975983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:54.977940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.002651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:55.009206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 466/938] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:54 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:55.012510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a1ebc-ace1-441a-a59f-0ec506c82792 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:55.017177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:55.017921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:55.018209 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:55.018490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:55.027597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:55.029440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.041485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 473/939] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:55 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:55.047725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:55.058278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc5bcd-eba6-47b2-b311-4248daedf4c6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:55.062836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:55.063627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:55.063909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:55.064187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:55.075095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:55.076939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.093656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:55.095071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 467/940] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:55.101117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:55.109896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3119e-b62a-4534-99d7-8de59ae611c5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:55.114999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:55.115712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:55.116061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:55.116400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:55.117175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:55.117539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:55.119206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.131073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 474/941] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:55.137300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:55.147522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21e9e-2ab4-449b-9ffe-ed572722ba50 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:55.152009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:55.152831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:55.153128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:55.153387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:55.160381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:55.162423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.175400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:55.177281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 468/942] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:55.183411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:55.195222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642cc8cf-e5ea-4bcf-a198-865ed8655b99 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:55.199725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:55.200620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:55.200994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:55.201199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:55.201966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:55.202276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:55.204182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75266b7d-1d3b-4222-8fab-0cc6b81d5f00 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.222501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 475/943] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:55.223595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:55.233865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0e65c-f74f-44ad-a25a-c51569011388 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:55.238347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:55.239523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:55.239802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:55.240429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:55.240933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] RBAC: Adding query filter params (role.id=86a6457b304a4886a2fb7aba61842f67, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=0b340b0c363a4c1ebaf9311b7349a6d2) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:55.241240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:55.243112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538299d-ad76-41f8-afb5-cf34cb3f583a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:55.248630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 469/944] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:55 2021] GET /identity/v3/role_assignments?user.id=0b340b0c363a4c1ebaf9311b7349a6d2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=86a6457b304a4886a2fb7aba61842f67 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:56.504603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd04f-bec6-467d-b2ce-9ee95a17e954 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.505122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd04f-bec6-467d-b2ce-9ee95a17e954 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.505198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cd04f-bec6-467d-b2ce-9ee95a17e954 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.507230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 476/945] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:56.513157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.513564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.513738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.535400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:56.537214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:56.545080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 470/946] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:56.570058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cd04f-bec6-467d-b2ce-9ee95a17e954 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:56.582023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cd04f-bec6-467d-b2ce-9ee95a17e954 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:56.586850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c9d82-f4cc-4222-b36c-2eba8deee605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:56.587877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9d82-f4cc-4222-b36c-2eba8deee605 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.588161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9d82-f4cc-4222-b36c-2eba8deee605 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.588434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c9d82-f4cc-4222-b36c-2eba8deee605 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.589589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c9d82-f4cc-4222-b36c-2eba8deee605 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:56.591314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c9d82-f4cc-4222-b36c-2eba8deee605 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:56.593063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 477/947] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:56.599593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:56.608464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f990-f60e-4dec-94b4-383aa945005c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:56.612918 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a7f03-fbe0-4823-b113-82a2e3f28e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:56.613571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a7f03-fbe0-4823-b113-82a2e3f28e0b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.613877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a7f03-fbe0-4823-b113-82a2e3f28e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.614152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a7f03-fbe0-4823-b113-82a2e3f28e0b admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.614889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a7f03-fbe0-4823-b113-82a2e3f28e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:56.616782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a7f03-fbe0-4823-b113-82a2e3f28e0b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:56.718908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 471/948] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:58:56 2021] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:58:56.768362 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351c61-0e28-435a-af9c-1da60682b383 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.768647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351c61-0e28-435a-af9c-1da60682b383 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.768843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb351c61-0e28-435a-af9c-1da60682b383 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.771042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 478/949] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:56.777245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.777532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.777813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.797604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:56.798886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:56.807639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 472/950] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:56.831786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351c61-0e28-435a-af9c-1da60682b383 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:56.844454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb351c61-0e28-435a-af9c-1da60682b383 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:56.849583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f3742-9f88-4694-b206-fed5dbb9d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:56.850246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f3742-9f88-4694-b206-fed5dbb9d78f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.850528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f3742-9f88-4694-b206-fed5dbb9d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.850828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f3742-9f88-4694-b206-fed5dbb9d78f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.859547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f3742-9f88-4694-b206-fed5dbb9d78f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:56.861325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f3742-9f88-4694-b206-fed5dbb9d78f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:56.871847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 479/951] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:56.878201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:56.887437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfc092-6ec9-4051-868f-00e843db5f3b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:56.893541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653bb2e-fea3-49cc-91de-ead7b7092c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:56.894324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653bb2e-fea3-49cc-91de-ead7b7092c94 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:56.894629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653bb2e-fea3-49cc-91de-ead7b7092c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:56.894905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653bb2e-fea3-49cc-91de-ead7b7092c94 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:56.896101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653bb2e-fea3-49cc-91de-ead7b7092c94 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:56.897777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6653bb2e-fea3-49cc-91de-ead7b7092c94 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:56.899578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 473/952] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:57.375420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28371007-da03-4ba8-b018-95217c241fdc None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.375708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28371007-da03-4ba8-b018-95217c241fdc None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.375985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28371007-da03-4ba8-b018-95217c241fdc None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.377807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 480/953] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:57.384284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.384633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.384976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.402286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:57.403477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:57.411026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 474/954] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:57 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:57.435538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28371007-da03-4ba8-b018-95217c241fdc None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.448110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28371007-da03-4ba8-b018-95217c241fdc None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.452441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.453235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.453517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.453791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.464276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:57.474392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 04:58:57.475619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 481/955] 10.222.0.16 () {56 vars in 1142 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:57.482296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.491821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b84356-15ad-4494-a9ab-c15acf521826 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.496365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.497024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.497306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.497578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.498322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:57.498656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.500243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.508817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 475/956] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:57.514929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.525398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4e761-a9be-4594-9885-6c726d5c53e6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.529928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.530740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.531023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.531296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.541745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.543920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.561135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:57.562330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 482/957] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:57.569212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.578959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c811c-3fff-41f0-a672-96dd8e22edd7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.583699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.584423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.584776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.585119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.585902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:57.586294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.588254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.600582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 476/958] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:57.607015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.617161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c375867-4ee8-4fd0-9f0b-1f3a85d8cde8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.621744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.622515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.622823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.623095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.630257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.632236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.646650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:58:57.647937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 483/959] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:57.654173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.664320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7514d47-c9d2-4c9a-b11e-075d2b92cb75 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.668914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.669642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.669988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.670344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.671271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:57.671646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.673545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.695577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 477/960] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:57.697063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.706474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086b115-ea0d-480b-ac64-3d1c20c505f5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.710979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.711742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.712042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.712560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.722341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.724701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.741248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:58:57.742347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 484/961] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:57.748695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.758272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f620eb-f43e-4b25-97a2-e44a4873b0dd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.762818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.763464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.763747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.764022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.764730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:57.765034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.766630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.777644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 478/962] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:57.783893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.793834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05069e6-9549-4745-913e-d700ee2994e0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.798394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.799192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.799472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.799742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.806930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.808858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.821333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:58:57.822473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 485/963] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:58:57.828927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.839003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d5fd5-9cf4-4a13-996d-14e7acb6ecfb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.843522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.844171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.844455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.844728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.845502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:57.845811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.847695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782a31e-f47f-43d8-b0fc-8c180799f8af admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.860079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 479/964] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:58:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:57.867201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:57.883750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800cfee-22fd-4e3d-ba16-98e7b1c14500 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:57.888210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5f47-4579-4163-9d57-68374ef1dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:57.889102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5f47-4579-4163-9d57-68374ef1dd47 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:57.889368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5f47-4579-4163-9d57-68374ef1dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:57.889642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5f47-4579-4163-9d57-68374ef1dd47 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/0b340b0c363a4c1ebaf9311b7349a6d2/roles/86a6457b304a4886a2fb7aba61842f67` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:57.891857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5f47-4579-4163-9d57-68374ef1dd47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=0b340b0c363a4c1ebaf9311b7349a6d2, role_id=86a6457b304a4886a2fb7aba61842f67)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:57.894515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5f47-4579-4163-9d57-68374ef1dd47 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:57.968049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 486/965] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:58:57 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/0b340b0c363a4c1ebaf9311b7349a6d2/roles/86a6457b304a4886a2fb7aba61842f67 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:58:58.891465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4f06-6d7d-4d2a-a4af-feb29f17ea9e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:58.891972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4f06-6d7d-4d2a-a4af-feb29f17ea9e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:58.891972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac4f06-6d7d-4d2a-a4af-feb29f17ea9e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:58.893707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 480/966] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:58:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:58:58.899601 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:58.899987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:58.900155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:58.916953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:58:58.918135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:58:58.974028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 487/967] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:58:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:58:58.998516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4f06-6d7d-4d2a-a4af-feb29f17ea9e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:59.010654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac4f06-6d7d-4d2a-a4af-feb29f17ea9e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:59.014978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:59.015758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:59.016039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:59.016310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:59.026813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:58:59.033630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:58:59.034961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 481/968] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:58:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:58:59.041895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:59.050929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51551ad5-06fa-4b43-8089-fbc743628fb7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:59.055600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:59.056329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:59.056686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:59.057051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:59.057870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:59.058248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:59.059883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:59.068700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 488/969] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:58:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:59.074758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:59.085456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56f96f-e90d-45b8-90a9-8a6e92652bb4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:59.090244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:59.091131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:59.091418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:59.091691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] PATH_INFO: `/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:59.105107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] RBAC: Authorizing `identity:get_user(user_id=53c67278ecfa4e62b8abd2f13a8fef9a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:59.107349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:59.109326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 482/970] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:58:59 2021] GET /identity/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:58:59.115763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:59.125401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2e75-436e-4207-9cd6-e580d8ff8086 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:59.130340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:59.131019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:59.131285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:59.131556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:59.139081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:59.140842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:59.149737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 489/971] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:58:59 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:58:59.156037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:59.166079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7e23-c1f8-41fc-a56e-7cc24d5a7364 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:59.170566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faf2c2d-2873-4160-80f6-5417c1d22bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:59.171425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf2c2d-2873-4160-80f6-5417c1d22bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:59.171706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf2c2d-2873-4160-80f6-5417c1d22bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:59.171985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf2c2d-2873-4160-80f6-5417c1d22bb4 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:59.173139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf2c2d-2873-4160-80f6-5417c1d22bb4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:59.175223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faf2c2d-2873-4160-80f6-5417c1d22bb4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:59.177444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 483/972] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:58:59 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:58:59.183866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:58:59.192594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdef68-082b-48f3-aa81-6dee233bd519 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:58:59.197129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:58:59.197773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:58:59.198056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:58:59.198332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:58:59.199183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=4b85582f80fd41e99891f479d3dc661d, user.id=53c67278ecfa4e62b8abd2f13a8fef9a) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:58:59.199495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:58:59.201326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6b44-5dde-485a-88b0-e3453258a241 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:58:59.206552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 490/973] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:58:59 2021] GET /identity/v3/role_assignments?user.id=53c67278ecfa4e62b8abd2f13a8fef9a&scope.project.id=4b85582f80fd41e99891f479d3dc661d&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:00.075220 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522ad98-c529-40ec-8684-11ae7c6e015b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.075771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522ad98-c529-40ec-8684-11ae7c6e015b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.075771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7522ad98-c529-40ec-8684-11ae7c6e015b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.077544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 484/974] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:00.084169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.084571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.084811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.102374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:00.103573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:00.111117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 491/975] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:00.135944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522ad98-c529-40ec-8684-11ae7c6e015b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.148383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7522ad98-c529-40ec-8684-11ae7c6e015b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.152725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.153518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.153799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.154071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.164101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:00.171371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 10 04:59:00.172677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 485/976] 10.222.0.16 () {56 vars in 1142 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:00.179191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.188054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f81e74-1950-4c13-af96-9e5f22d4f17f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.193066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.193719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.193999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.194270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.195048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:00.195353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.196933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.204908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 492/977] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:00.212076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.222658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245cf02-6ccb-4fb8-8b25-83851e880599 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.227110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.227883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.228159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.228425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.238476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.240819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.257403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:59:00.258554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 486/978] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:00.264859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.274794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165c3a6-2633-4cc7-a4d4-e633e0455710 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.279233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.279913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.280198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.280495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.281205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:00.281511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.283123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.294492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 493/979] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:00.302113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.311639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe1e00-0985-4480-939e-582a746fd353 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.316170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.316992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.317842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.318118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.326426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.328435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.343387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 10 04:59:00.344729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 487/980] 10.222.0.16 () {56 vars in 1115 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:00.351008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.360589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6afeb-a9b1-4fc1-ab6b-dbe11e835a88 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.365719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.366379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.366693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.366971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.367799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:00.368106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.369940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.387355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 494/981] 10.222.0.16 () {56 vars in 1155 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:00.393684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.403462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c3ea1-2d9f-4313-a9de-79b71e2e1415 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.407988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.408695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.408980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.409254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.416976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.418774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.428164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 488/982] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:00.434602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.444748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18392328-23ab-45b2-be95-1e441ca097d3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.449242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.450014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.450297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.450571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.460501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.462628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.478622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 04:59:00.479744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 495/983] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:00.485673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.494820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760fcfa-fd2a-4d7c-9736-d20f421d6fa7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.499346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.499981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.500261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.500536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.501243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:00.501546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.503126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.519307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 489/984] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:00.520527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.530123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865eba52-b232-4bc0-8628-3c3c7b2f5e41 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.534729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.535503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.535784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.536057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.542757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.544708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.557630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 04:59:00.558790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 496/985] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:00.565023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.575113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c0adb-c116-4b1d-a5e4-1bfb21c99bca admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.579650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.580238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.580517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.580788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.581595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:00.581906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.583789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a3e1b-c3c0-4ffd-b992-71c005b1a6df admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.596081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 490/986] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:59:00.603516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:00.613879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68ddb3-6d68-4a2e-8906-9a1a10b8001e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:00.618978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:00.619677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:00.620022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:00.620376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:00.621194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] RBAC: Adding query filter params (role.id=86a6457b304a4886a2fb7aba61842f67, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=0b340b0c363a4c1ebaf9311b7349a6d2) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:00.621500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:00.623367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95088da4-3665-4845-b7d3-7ba5b32d133e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:00.630107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 497/987] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:00 2021] GET /identity/v3/role_assignments?user.id=0b340b0c363a4c1ebaf9311b7349a6d2&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=86a6457b304a4886a2fb7aba61842f67 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:01.282840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30703-0851-4908-ba8b-771b4ff4c2ad None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.283360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30703-0851-4908-ba8b-771b4ff4c2ad None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.283479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb30703-0851-4908-ba8b-771b4ff4c2ad None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.285141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 491/988] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:01.291795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.292222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.292491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.310696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:01.311895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:01.320208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 498/989] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:01.344392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb30703-0851-4908-ba8b-771b4ff4c2ad None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:01.357198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb30703-0851-4908-ba8b-771b4ff4c2ad None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:01.361883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:01.362715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.362999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.363272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.374273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:01.381329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:01.382554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 492/990] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:01.389576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:01.399031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c4234-4d58-4b4e-9402-1c6d4acee868 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:01.404553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:01.405218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.405502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.405779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.406526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:01.406856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:01.408579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:01.417659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 499/991] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:59:01.424403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:01.435412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f70ba5-feb3-4013-9b03-218073129238 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:01.440033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:01.440888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.441177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.441450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] PATH_INFO: `/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.442692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] RBAC: Authorizing `identity:get_user(user_id=53c67278ecfa4e62b8abd2f13a8fef9a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:01.444808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:01.446380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 493/992] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:01 2021] GET /identity/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:01.452612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:01.461974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159244-304c-4c24-8832-91b2144a259b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:01.466701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6b43a-767c-4bb5-b496-70af883f0b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:01.467539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6b43a-767c-4bb5-b496-70af883f0b82 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.467821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6b43a-767c-4bb5-b496-70af883f0b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.468096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6b43a-767c-4bb5-b496-70af883f0b82 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.469274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6b43a-767c-4bb5-b496-70af883f0b82 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:01.471373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b6b43a-767c-4bb5-b496-70af883f0b82 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:01.472984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 500/993] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:01 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:01.479422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:01.488760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ce78-33e7-4fed-aa78-558d1a49489c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:01.493970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb72f2-8fba-4059-8412-dbc65962dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:01.494846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb72f2-8fba-4059-8412-dbc65962dc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:01.495130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb72f2-8fba-4059-8412-dbc65962dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:01.495406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb72f2-8fba-4059-8412-dbc65962dc28 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d/users/53c67278ecfa4e62b8abd2f13a8fef9a/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:01.497338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb72f2-8fba-4059-8412-dbc65962dc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b85582f80fd41e99891f479d3dc661d, user_id=53c67278ecfa4e62b8abd2f13a8fef9a, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:01.499953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb72f2-8fba-4059-8412-dbc65962dc28 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:01.573119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 494/994] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:59:01 2021] PUT /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d/users/53c67278ecfa4e62b8abd2f13a8fef9a/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:59:03.648440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5de83d-9fdd-4028-bf8f-ea0c1341e92b None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.648969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5de83d-9fdd-4028-bf8f-ea0c1341e92b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.648969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5de83d-9fdd-4028-bf8f-ea0c1341e92b None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.650779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 501/995] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:03.656677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.657072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.657230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.674899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:03.676065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:03.731172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 495/996] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:03.756076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5de83d-9fdd-4028-bf8f-ea0c1341e92b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:03.767961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5de83d-9fdd-4028-bf8f-ea0c1341e92b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:03.772362 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:03.773075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.773352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.773623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.783764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:03.790893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:03.792012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 502/997] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 04:59:03.798452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:03.807853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68a199-384c-45ae-b406-f1cb00d45b03 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:03.812312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:03.812957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.813237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.813509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.814248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:03.814556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:03.816159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:03.824176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 496/998] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:03.830590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:03.840075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6c23dc-eaba-41e9-b6a6-3fd67c384ea2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:03.844474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:03.845299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.845580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.845878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] PATH_INFO: `/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.847061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] RBAC: Authorizing `identity:get_user(user_id=53c67278ecfa4e62b8abd2f13a8fef9a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:03.849703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:03.851258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 503/999] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:03 2021] GET /identity/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:03.856985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:03.866697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ad9a4-c3ad-4fbd-82c0-9273bed9a301 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:03.871198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:03.871804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.872085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.872356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.879855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:03.881552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:03.890112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 497/1000] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:03 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:03.896059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:03.905131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea742c7-b3b0-472a-85db-bcb4e0e2863b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:03.909675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30503c2b-9f69-4736-83c6-04eb5829e290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:03.910472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503c2b-9f69-4736-83c6-04eb5829e290 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.911317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503c2b-9f69-4736-83c6-04eb5829e290 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.911599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30503c2b-9f69-4736-83c6-04eb5829e290 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.912734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503c2b-9f69-4736-83c6-04eb5829e290 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:03.914756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30503c2b-9f69-4736-83c6-04eb5829e290 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:03.916333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 504/1001] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:03 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:03.922260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:03.931234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224382e7-2f5c-4a0c-b699-2e803acd88b5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:03.935672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:03.936284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:03.936560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:03.936826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:03.937625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=4b85582f80fd41e99891f479d3dc661d, user.id=53c67278ecfa4e62b8abd2f13a8fef9a) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:03.937928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:03.939740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892367e2-e7b7-41ab-b15c-4ad714ae5636 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:03.945253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 498/1002] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:03 2021] GET /identity/v3/role_assignments?user.id=53c67278ecfa4e62b8abd2f13a8fef9a&scope.project.id=4b85582f80fd41e99891f479d3dc661d&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:06.080403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a716b-f292-48bb-940c-af2814fd3245 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:06.080961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a716b-f292-48bb-940c-af2814fd3245 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:06.080961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a716b-f292-48bb-940c-af2814fd3245 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:06.082779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 505/1003] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:06.088779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:06.089194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:06.089340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:06.106998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:06.108195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:06.116349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 499/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:06.141011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a716b-f292-48bb-940c-af2814fd3245 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:06.153200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a716b-f292-48bb-940c-af2814fd3245 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:06.157726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a949e-634e-4329-8621-68af5af3cdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:06.158492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a949e-634e-4329-8621-68af5af3cdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:06.158806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a949e-634e-4329-8621-68af5af3cdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:06.159082 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a949e-634e-4329-8621-68af5af3cdd8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:06.160235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a949e-634e-4329-8621-68af5af3cdd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:06.162435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a949e-634e-4329-8621-68af5af3cdd8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:06.164024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 506/1005] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:59:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:06.169927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:06.179277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4876a-f661-47fe-b166-87ec9d7d36ec None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:06.183763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107261b-4faf-4a30-8b66-4786d162f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:06.184411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107261b-4faf-4a30-8b66-4786d162f639 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:06.184696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107261b-4faf-4a30-8b66-4786d162f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:06.184971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107261b-4faf-4a30-8b66-4786d162f639 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:06.185678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107261b-4faf-4a30-8b66-4786d162f639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:06.187618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107261b-4faf-4a30-8b66-4786d162f639 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:06.287830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 500/1006] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:59:06 2021] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:59:08.440165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93cbb-ac28-482a-9a89-6c3648c3dff7 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.440693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93cbb-ac28-482a-9a89-6c3648c3dff7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.440693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a93cbb-ac28-482a-9a89-6c3648c3dff7 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.443014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 507/1007] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:08.448888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.449313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.449447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.467531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:08.468715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:08.476400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 501/1008] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:08 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:08.500694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93cbb-ac28-482a-9a89-6c3648c3dff7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:08.513410 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a93cbb-ac28-482a-9a89-6c3648c3dff7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:08.517920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:08.518791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.519075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.519348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] PATH_INFO: `/v3/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.520804 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] RBAC: Authorizing `identity:get_role(role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:08.522167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:59:08.522167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:59:08.522167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:59:08.522702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:08.524013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 508/1009] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:08 2021] GET /identity/v3/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:08.530113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:08.539062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28082219-9578-4137-bb81-6fca23c3cb0d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:08.543574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:08.544427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.544711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.544986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] PATH_INFO: `/v3/users/999ec943721447cc8f302a8bacce83ee` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.558368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] RBAC: Authorizing `identity:get_user(user_id=999ec943721447cc8f302a8bacce83ee)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:08.560525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:08.562119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 502/1010] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:08 2021] GET /identity/v3/users/999ec943721447cc8f302a8bacce83ee => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:08.568733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:08.578037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1004057-922a-4249-94f6-ba3480b2e456 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:08.582445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:08.583169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.583450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.583722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.591390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:08.593095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:08.601588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 509/1011] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:08 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 04:59:08.607592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:08.617247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea07387-67db-4661-82fe-dd4c8a1a2815 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:08.621746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244485d1-14d7-4904-b5e6-c09fe7780543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:08.622563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244485d1-14d7-4904-b5e6-c09fe7780543 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.622872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244485d1-14d7-4904-b5e6-c09fe7780543 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.623147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244485d1-14d7-4904-b5e6-c09fe7780543 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.624303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244485d1-14d7-4904-b5e6-c09fe7780543 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:08.626298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244485d1-14d7-4904-b5e6-c09fe7780543 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:08.627939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 503/1012] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:08 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:08.634490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:08.642771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6164b9-2323-4390-a37e-ed355aa03f76 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:08.647153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:08.647755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:08.648034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:08.648306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:08.649097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] RBAC: Adding query filter params (role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=4b85582f80fd41e99891f479d3dc661d, user.id=999ec943721447cc8f302a8bacce83ee) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:08.649402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:08.651198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fce374-2a2c-4211-b0eb-52b440659b6f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:08.656242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 510/1013] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:08 2021] GET /identity/v3/role_assignments?user.id=999ec943721447cc8f302a8bacce83ee&scope.project.id=4b85582f80fd41e99891f479d3dc661d&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:10.738383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79114c6-ff49-40df-bb96-fb482ba58623 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:10.739501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79114c6-ff49-40df-bb96-fb482ba58623 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:10.739501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79114c6-ff49-40df-bb96-fb482ba58623 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:10.741254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 504/1014] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:10.747099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:10.747492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:10.747655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:10.765644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:10.766855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:10.774851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 511/1015] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:10.797946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79114c6-ff49-40df-bb96-fb482ba58623 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:10.810362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79114c6-ff49-40df-bb96-fb482ba58623 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:10.814664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:10.815505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:10.815785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:10.816058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] PATH_INFO: `/v3/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:10.818115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] RBAC: Authorizing `identity:get_role(role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:10.819151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:59:10.819151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 04:59:10.819151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 04:59:10.820033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:10.821322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 505/1016] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:10 2021] GET /identity/v3/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:10.827273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:10.836030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2938c0-b9b7-4aa4-b171-7c1871b9f238 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:10.840818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:10.841659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:10.841940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:10.842214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] PATH_INFO: `/v3/users/999ec943721447cc8f302a8bacce83ee` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:10.843459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] RBAC: Authorizing `identity:get_user(user_id=999ec943721447cc8f302a8bacce83ee)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:10.845583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:10.847181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 512/1017] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:10 2021] GET /identity/v3/users/999ec943721447cc8f302a8bacce83ee => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:10.853201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:10.862332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56f4b1-f1e2-4f49-b3fc-c1153cbbf775 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:10.867349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c7247-3a0e-4f78-a942-78ae81c78f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:10.868144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c7247-3a0e-4f78-a942-78ae81c78f38 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:10.868423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c7247-3a0e-4f78-a942-78ae81c78f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:10.868696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c7247-3a0e-4f78-a942-78ae81c78f38 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:10.869836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c7247-3a0e-4f78-a942-78ae81c78f38 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:10.871840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c7247-3a0e-4f78-a942-78ae81c78f38 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:10.873410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 506/1018] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:10 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:10.879196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:10.888932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e33000-473a-4599-a7ff-916a4bd39838 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:10.893445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33614b62-9477-46f2-8aa5-cb13e2d561a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:10.894266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614b62-9477-46f2-8aa5-cb13e2d561a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:10.894552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614b62-9477-46f2-8aa5-cb13e2d561a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:10.894855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33614b62-9477-46f2-8aa5-cb13e2d561a7 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d/users/999ec943721447cc8f302a8bacce83ee/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:10.897008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614b62-9477-46f2-8aa5-cb13e2d561a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b85582f80fd41e99891f479d3dc661d, user_id=999ec943721447cc8f302a8bacce83ee, role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:10.899629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33614b62-9477-46f2-8aa5-cb13e2d561a7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:10.998139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 513/1019] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:59:10 2021] PUT /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d/users/999ec943721447cc8f302a8bacce83ee/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 04:59:13.076091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e082-acf1-4122-89f0-0f3cf44cc85c None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.076647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e082-acf1-4122-89f0-0f3cf44cc85c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.076647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185e082-acf1-4122-89f0-0f3cf44cc85c None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.078401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 507/1020] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:13.084709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.085094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.085253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.103325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:13.104500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:13.159560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 514/1021] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:13.184238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185e082-acf1-4122-89f0-0f3cf44cc85c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:13.196050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185e082-acf1-4122-89f0-0f3cf44cc85c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:13.200353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:13.201177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.201455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.201726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] PATH_INFO: `/v3/roles/dc2320bb92ba464b919fdde42cb06f24` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.203196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] RBAC: Authorizing `identity:get_role(role_id=dc2320bb92ba464b919fdde42cb06f24)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:13.204773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:13.206046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 508/1022] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:13 2021] GET /identity/v3/roles/dc2320bb92ba464b919fdde42cb06f24 => generated 223 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:13.212452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:13.221293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc1eae-c66b-4c44-a8a4-ece522768dbb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:13.225745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:13.226596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.226897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.227172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] PATH_INFO: `/v3/users/999ec943721447cc8f302a8bacce83ee` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.228347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] RBAC: Authorizing `identity:get_user(user_id=999ec943721447cc8f302a8bacce83ee)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:13.230481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:13.232073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 515/1023] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:13 2021] GET /identity/v3/users/999ec943721447cc8f302a8bacce83ee => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:13.237896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:13.247406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2528924-bb05-49ab-973e-c16de4954d68 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:13.251791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:13.252376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.252655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.252923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.260441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:13.262110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:13.271128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 509/1024] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:13 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:13.277095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:13.286689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac414130-d2d6-43e1-8704-203e56ed1814 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:13.291099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8211ec2e-e544-4aa4-a920-f2335fbad2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:13.291891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec2e-e544-4aa4-a920-f2335fbad2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.292171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec2e-e544-4aa4-a920-f2335fbad2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.292442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8211ec2e-e544-4aa4-a920-f2335fbad2b9 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.293570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211ec2e-e544-4aa4-a920-f2335fbad2b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:13.295572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8211ec2e-e544-4aa4-a920-f2335fbad2b9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:13.297139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 516/1025] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:13 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:13.303179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:13.311421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db9cce-b93d-4a76-b567-d41c535c97b4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:13.315874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:13.316464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:13.316744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:13.317015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:13.318300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] RBAC: Adding query filter params (role.id=dc2320bb92ba464b919fdde42cb06f24, scope.project.id=4b85582f80fd41e99891f479d3dc661d, user.id=999ec943721447cc8f302a8bacce83ee) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:13.318628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:13.320389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64950394-ba7f-4cf5-b772-219541f9f093 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:13.325867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 510/1026] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:13 2021] GET /identity/v3/role_assignments?user.id=999ec943721447cc8f302a8bacce83ee&scope.project.id=4b85582f80fd41e99891f479d3dc661d&role.id=dc2320bb92ba464b919fdde42cb06f24 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:59:15.402366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fb67-cbb1-4d72-b70a-e01a4847244c None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:15.402955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fb67-cbb1-4d72-b70a-e01a4847244c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:15.402955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6fb67-cbb1-4d72-b70a-e01a4847244c None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:15.404717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 517/1027] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:15.410434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:15.410861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:15.411567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:15.428526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:15.429692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:15.437125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 511/1028] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:15.462113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fb67-cbb1-4d72-b70a-e01a4847244c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:15.475121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6fb67-cbb1-4d72-b70a-e01a4847244c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:15.479478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df450b-17ef-4d53-ba24-6d2e784e8a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:15.480284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df450b-17ef-4d53-ba24-6d2e784e8a46 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:15.480569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df450b-17ef-4d53-ba24-6d2e784e8a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:15.480836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df450b-17ef-4d53-ba24-6d2e784e8a46 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:15.481987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df450b-17ef-4d53-ba24-6d2e784e8a46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:15.483693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df450b-17ef-4d53-ba24-6d2e784e8a46 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:15.485274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 518/1029] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:59:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:15.491399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:15.500159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc4cd-7176-4c26-8d80-0cb16274a501 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:15.504555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd2dd6-58c0-4e87-983f-4076fa335cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:15.505221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2dd6-58c0-4e87-983f-4076fa335cea admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:15.505500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2dd6-58c0-4e87-983f-4076fa335cea admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:15.505771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd2dd6-58c0-4e87-983f-4076fa335cea admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:15.506463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd2dd6-58c0-4e87-983f-4076fa335cea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:15.508367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd2dd6-58c0-4e87-983f-4076fa335cea admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:15.602658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 512/1030] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:59:15 2021] POST /identity/v3/projects => generated 311 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:59:17.750059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e768e-007f-42e7-9477-200bdbe5f0ce None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:17.750608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e768e-007f-42e7-9477-200bdbe5f0ce None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:17.750608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e768e-007f-42e7-9477-200bdbe5f0ce None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:17.752487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 519/1031] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:17.758398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:17.758791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:17.759002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:17.776691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:17.777805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:17.832088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 513/1032] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:17.857521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e768e-007f-42e7-9477-200bdbe5f0ce None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:17.869300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e768e-007f-42e7-9477-200bdbe5f0ce None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:17.873535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc436b9-1bd3-4e27-bce4-b753a29cfc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:17.874298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc436b9-1bd3-4e27-bce4-b753a29cfc8d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:17.874597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc436b9-1bd3-4e27-bce4-b753a29cfc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:17.874882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc436b9-1bd3-4e27-bce4-b753a29cfc8d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:17.876052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc436b9-1bd3-4e27-bce4-b753a29cfc8d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:17.877714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc436b9-1bd3-4e27-bce4-b753a29cfc8d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:17.879307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 520/1033] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 04:59:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:17.886256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:17.895029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9783c-71b7-4891-9ac7-7873b45ecdfd None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:17.900024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3fa39-d4ae-4277-b762-ef2a8fe6276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:17.900671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3fa39-d4ae-4277-b762-ef2a8fe6276f admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:17.900952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3fa39-d4ae-4277-b762-ef2a8fe6276f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:17.901218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3fa39-d4ae-4277-b762-ef2a8fe6276f admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:17.901912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3fa39-d4ae-4277-b762-ef2a8fe6276f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:17.903837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3fa39-d4ae-4277-b762-ef2a8fe6276f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:18.015932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 514/1034] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:59:17 2021] POST /identity/v3/users => generated 286 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:59:20.151080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5a8b-3d8a-4a58-8c34-97e928e57734 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.151642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5a8b-3d8a-4a58-8c34-97e928e57734 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.151642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5a8b-3d8a-4a58-8c34-97e928e57734 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.153473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 521/1035] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:20.159364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879d66-832a-4378-9d23-080256b67128 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.159759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879d66-832a-4378-9d23-080256b67128 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.159919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7879d66-832a-4378-9d23-080256b67128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.178399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c7879d66-832a-4378-9d23-080256b67128 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:20.179618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c7879d66-832a-4378-9d23-080256b67128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:20.187239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 515/1036] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:20.211461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a5a8b-3d8a-4a58-8c34-97e928e57734 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:20.224014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a5a8b-3d8a-4a58-8c34-97e928e57734 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:20.228305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:20.229072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.229352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.229625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.240119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:20.246761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:20.247838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 522/1037] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:20.254149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879d66-832a-4378-9d23-080256b67128 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:20.263052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7879d66-832a-4378-9d23-080256b67128 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:20.267527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:20.268178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.268459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.268734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.269539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:20.269847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:20.271462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:20.279483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 516/1038] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:20.285527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:20.296089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cef76f-ef81-4d09-babf-ba770ba2fb68 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:20.300558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:20.301383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.302281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.302553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] PATH_INFO: `/v3/users/322c9f712ca04a63bb11e511e734fd4a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.315085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] RBAC: Authorizing `identity:get_user(user_id=322c9f712ca04a63bb11e511e734fd4a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:20.317193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:20.318806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 523/1039] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:20 2021] GET /identity/v3/users/322c9f712ca04a63bb11e511e734fd4a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:20.325055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:20.334420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022ad35-fb68-456b-a353-19752fa2e404 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:20.339137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:20.344264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.344264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.344264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.347841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:20.350195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:20.358958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 517/1040] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:20 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:20.365102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:20.374492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8ffc7-24f7-46a4-b491-1c687c30eb19 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:20.379057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18226d58-19a5-45eb-aa6d-193477387548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:20.380408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18226d58-19a5-45eb-aa6d-193477387548 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.380689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18226d58-19a5-45eb-aa6d-193477387548 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.380963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18226d58-19a5-45eb-aa6d-193477387548 admin admin] PATH_INFO: `/v3/projects/79885c02a227401887073ba7ae7f4ff7` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.382144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18226d58-19a5-45eb-aa6d-193477387548 admin admin] RBAC: Authorizing `identity:get_project(project_id=79885c02a227401887073ba7ae7f4ff7)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:20.384274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18226d58-19a5-45eb-aa6d-193477387548 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:20.385908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 524/1041] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:20 2021] GET /identity/v3/projects/79885c02a227401887073ba7ae7f4ff7 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:20.392088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:20.401441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa278eb-700c-4d9e-a796-67941321c422 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:20.405924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:20.406542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:20.406857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:20.407132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:20.408011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=79885c02a227401887073ba7ae7f4ff7, user.id=322c9f712ca04a63bb11e511e734fd4a) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:20.408321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:20.410132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb1327-4bf3-4cfc-90b2-bf360916c6a4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:20.415331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 518/1042] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:20 2021] GET /identity/v3/role_assignments?user.id=322c9f712ca04a63bb11e511e734fd4a&scope.project.id=79885c02a227401887073ba7ae7f4ff7&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:22.466976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafebd2-6197-449f-81b6-3f45550e49c1 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.467540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafebd2-6197-449f-81b6-3f45550e49c1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.467540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafebd2-6197-449f-81b6-3f45550e49c1 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.469279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 525/1043] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:22.475500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.475912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.476059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.493972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:22.495183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:22.502703 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 519/1044] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:22 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:22.525843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafebd2-6197-449f-81b6-3f45550e49c1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:22.538285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafebd2-6197-449f-81b6-3f45550e49c1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:22.542785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:22.543586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.543976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.544269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.555048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:22.561667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:22.562840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 526/1045] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:22.569237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:22.578002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3403bf35-7e5c-4b9f-b26d-ebffb0b2cc20 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:22.582420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:22.583105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.583387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.583658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.584392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:22.584694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:22.586269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:22.594467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 520/1046] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:22.601060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:22.610819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca147a3-80c3-4099-a7a4-a270eead5b08 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:22.615889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:22.616709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.616989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.617261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] PATH_INFO: `/v3/users/322c9f712ca04a63bb11e511e734fd4a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.618424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] RBAC: Authorizing `identity:get_user(user_id=322c9f712ca04a63bb11e511e734fd4a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:22.620618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:22.622150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 527/1047] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:22 2021] GET /identity/v3/users/322c9f712ca04a63bb11e511e734fd4a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:22.627903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:22.636952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d26d95-14eb-46e8-b727-385c2d1b3653 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:22.641318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fe466-3e80-46f7-b14a-1b97ffa55e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:22.642128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe466-3e80-46f7-b14a-1b97ffa55e7a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.642405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe466-3e80-46f7-b14a-1b97ffa55e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.642713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fe466-3e80-46f7-b14a-1b97ffa55e7a admin admin] PATH_INFO: `/v3/projects/79885c02a227401887073ba7ae7f4ff7` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.643849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fe466-3e80-46f7-b14a-1b97ffa55e7a admin admin] RBAC: Authorizing `identity:get_project(project_id=79885c02a227401887073ba7ae7f4ff7)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:22.645867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2fe466-3e80-46f7-b14a-1b97ffa55e7a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:22.647468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 521/1048] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:22 2021] GET /identity/v3/projects/79885c02a227401887073ba7ae7f4ff7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:22.653302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:22.662851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc9e15-7234-4c18-a3b7-a0338681d622 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:22.667262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86544cfc-dbc5-4975-ab11-41b2914b81a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:22.668088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544cfc-dbc5-4975-ab11-41b2914b81a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:22.668367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544cfc-dbc5-4975-ab11-41b2914b81a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:22.668638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86544cfc-dbc5-4975-ab11-41b2914b81a6 admin admin] PATH_INFO: `/v3/projects/79885c02a227401887073ba7ae7f4ff7/users/322c9f712ca04a63bb11e511e734fd4a/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:22.670555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86544cfc-dbc5-4975-ab11-41b2914b81a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79885c02a227401887073ba7ae7f4ff7, user_id=322c9f712ca04a63bb11e511e734fd4a, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:22.673151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86544cfc-dbc5-4975-ab11-41b2914b81a6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:22.758364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 528/1049] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:59:22 2021] PUT /identity/v3/projects/79885c02a227401887073ba7ae7f4ff7/users/322c9f712ca04a63bb11e511e734fd4a/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:59:24.822621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10cf7-0b01-4af3-a4d3-e079ed659687 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:24.823149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10cf7-0b01-4af3-a4d3-e079ed659687 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:24.823149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f10cf7-0b01-4af3-a4d3-e079ed659687 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:24.824838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 522/1050] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:24.830631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:24.831005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:24.831192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:24.849130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:24.850319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:24.903989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 529/1051] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:24.927896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10cf7-0b01-4af3-a4d3-e079ed659687 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:24.939612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f10cf7-0b01-4af3-a4d3-e079ed659687 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:24.944518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:24.945287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:24.945565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:24.945833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:24.955617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:24.962903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:24.964305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 523/1052] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:24.970453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:24.979160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d1ef5-0c87-4630-9589-fac56882c955 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:24.983596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:24.984242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:24.984526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:24.984800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:24.985533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:24.985839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:24.987455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:24.995910 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 530/1053] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:25.001941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:25.011761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d799b23-4d22-4ddc-a3d8-808b6c3a1307 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:25.016158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:25.016980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:25.017255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:25.017524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] PATH_INFO: `/v3/users/322c9f712ca04a63bb11e511e734fd4a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:25.018724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] RBAC: Authorizing `identity:get_user(user_id=322c9f712ca04a63bb11e511e734fd4a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:25.021304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:25.022849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 524/1054] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:25 2021] GET /identity/v3/users/322c9f712ca04a63bb11e511e734fd4a => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:25.028560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:25.038202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba579b-c46f-48ec-950a-0bec89ce29b3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:25.042646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:25.043257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:25.043542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:25.043817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:25.051257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:25.052969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:25.061461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 531/1055] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:25 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:25.067351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:25.076451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6f2c9-65f2-4ca8-b004-8e28622f7c36 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:25.080813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f3851-91e2-44f5-9ab6-4c92b8a78edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:25.081612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3851-91e2-44f5-9ab6-4c92b8a78edc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:25.081888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3851-91e2-44f5-9ab6-4c92b8a78edc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:25.082156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f3851-91e2-44f5-9ab6-4c92b8a78edc admin admin] PATH_INFO: `/v3/projects/79885c02a227401887073ba7ae7f4ff7` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:25.083761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f3851-91e2-44f5-9ab6-4c92b8a78edc admin admin] RBAC: Authorizing `identity:get_project(project_id=79885c02a227401887073ba7ae7f4ff7)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:25.085730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f3851-91e2-44f5-9ab6-4c92b8a78edc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:25.087329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 525/1056] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:25 2021] GET /identity/v3/projects/79885c02a227401887073ba7ae7f4ff7 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:25.093505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:25.102345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbb53f-e52c-4463-b127-42c8baefab4d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:25.106800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:25.107403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:25.107688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:25.107964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:25.108762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=79885c02a227401887073ba7ae7f4ff7, user.id=322c9f712ca04a63bb11e511e734fd4a) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:25.109068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:25.110863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa1b3b-e961-43b9-ae46-7355a6b0624b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:25.116290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 532/1057] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:25 2021] GET /identity/v3/role_assignments?user.id=322c9f712ca04a63bb11e511e734fd4a&scope.project.id=79885c02a227401887073ba7ae7f4ff7&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:27.205736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5409f7-2ea9-4188-94bb-bb8deb713276 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:27.206267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5409f7-2ea9-4188-94bb-bb8deb713276 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:27.206267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5409f7-2ea9-4188-94bb-bb8deb713276 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:27.208109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 526/1058] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:27.214634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:27.215012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:27.215193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:27.232311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:27.233487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:27.241493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 533/1059] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:27.265065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5409f7-2ea9-4188-94bb-bb8deb713276 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:27.276771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5409f7-2ea9-4188-94bb-bb8deb713276 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:27.281102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:27.281722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:27.281998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:27.282268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:27.289619 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:27.291381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:27.299835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 527/1060] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:27 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:27.306295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:27.314884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ed171-e372-4a93-a558-545fcb719b38 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:27.319960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:27.320729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:27.321010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:27.321285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:27.327963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:27.329772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:27.343189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-ee57ecc8-2420-4e6f-9875-ee00af101e95 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 10 04:59:27.344283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 534/1061] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 04:59:27 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:27.350349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:27.358780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8494438-23fb-46e8-82b9-19b4a8e6435f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:27.363223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:27.363844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:27.364123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:27.364892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:27.365584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:27.365886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:27.367456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25f3d8-edc6-4ccb-ab8b-e669adfffed9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:27.374378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 528/1062] 10.222.0.16 () {56 vars in 1137 bytes} [Tue Aug 10 04:59:27 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:29.455615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf75d8e-b597-490f-b73d-b89e6f201d4f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:29.456162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf75d8e-b597-490f-b73d-b89e6f201d4f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:29.456162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf75d8e-b597-490f-b73d-b89e6f201d4f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:29.457932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 535/1063] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:29.464506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92178b-0cad-4dc1-badc-2bfc2487faf0 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:29.464916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92178b-0cad-4dc1-badc-2bfc2487faf0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:29.465050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92178b-0cad-4dc1-badc-2bfc2487faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:29.482648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1f92178b-0cad-4dc1-badc-2bfc2487faf0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:29.483821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1f92178b-0cad-4dc1-badc-2bfc2487faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:29.491222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 529/1064] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:29 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:29.515205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf75d8e-b597-490f-b73d-b89e6f201d4f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:29.527854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf75d8e-b597-490f-b73d-b89e6f201d4f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:29.532242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:29.532888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:29.533169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:29.533442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:29.534186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:29.535396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 04:59:29.535396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 04:59:29.535396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 04:59:29.536719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b6982-15af-4e35-a91d-54a750b5745b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:29.703137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 536/1065] 10.222.0.16 () {60 vars in 1160 bytes} [Tue Aug 10 04:59:29 2021] POST /identity/v3/domains => generated 267 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:59:31.846309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36678b-bb09-4ef6-a232-2879d965aaf2 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:31.846868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36678b-bb09-4ef6-a232-2879d965aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:31.846868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36678b-bb09-4ef6-a232-2879d965aaf2 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:31.848585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 530/1066] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:31.854994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:31.855425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:31.855544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:31.873427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:31.874638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:31.929204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 537/1067] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:31.953722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36678b-bb09-4ef6-a232-2879d965aaf2 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:31.965783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36678b-bb09-4ef6-a232-2879d965aaf2 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:31.970044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0135e-a0d8-4df4-8a30-fb437235ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:31.970905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0135e-a0d8-4df4-8a30-fb437235ce57 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:31.971188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0135e-a0d8-4df4-8a30-fb437235ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:31.971462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0135e-a0d8-4df4-8a30-fb437235ce57 admin admin] PATH_INFO: `/v3/domains/b6437cfd03c345b98ce78a382b5bbbee` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:31.981743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0135e-a0d8-4df4-8a30-fb437235ce57 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=b6437cfd03c345b98ce78a382b5bbbee)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:31.983774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0135e-a0d8-4df4-8a30-fb437235ce57 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:31.985365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 531/1068] 10.222.0.16 () {56 vars in 1205 bytes} [Tue Aug 10 04:59:31 2021] GET /identity/v3/domains/b6437cfd03c345b98ce78a382b5bbbee => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:31.991787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:32.000431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a04639-9bf7-453e-8ac6-4ae2972bfe09 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:32.005529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8c883-2718-40c7-a34b-9779f566ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:32.006178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8c883-2718-40c7-a34b-9779f566ba6b admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:32.006456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8c883-2718-40c7-a34b-9779f566ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:32.006763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8c883-2718-40c7-a34b-9779f566ba6b admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:32.007468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8c883-2718-40c7-a34b-9779f566ba6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:32.009343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8c883-2718-40c7-a34b-9779f566ba6b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:32.126386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 538/1069] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 04:59:31 2021] POST /identity/v3/projects => generated 361 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 04:59:34.236005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e70e-c13f-4d43-b368-f53ffbbee799 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:34.236554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e70e-c13f-4d43-b368-f53ffbbee799 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:34.236554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0e70e-c13f-4d43-b368-f53ffbbee799 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:34.238312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 532/1070] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:34.244575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430732b-2da5-42e6-b983-aca184879694 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:34.245009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430732b-2da5-42e6-b983-aca184879694 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:34.245139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430732b-2da5-42e6-b983-aca184879694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:34.262943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e430732b-2da5-42e6-b983-aca184879694 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:34.264123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e430732b-2da5-42e6-b983-aca184879694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:34.317657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 539/1071] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:34.343560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e70e-c13f-4d43-b368-f53ffbbee799 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:34.355958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0e70e-c13f-4d43-b368-f53ffbbee799 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:34.360312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708226b8-9054-4046-a7b5-a3dceeb72df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:34.361143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708226b8-9054-4046-a7b5-a3dceeb72df8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:34.361424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708226b8-9054-4046-a7b5-a3dceeb72df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:34.361698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708226b8-9054-4046-a7b5-a3dceeb72df8 admin admin] PATH_INFO: `/v3/domains/b6437cfd03c345b98ce78a382b5bbbee` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:34.362894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708226b8-9054-4046-a7b5-a3dceeb72df8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=b6437cfd03c345b98ce78a382b5bbbee)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:34.365444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708226b8-9054-4046-a7b5-a3dceeb72df8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:34.367020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 533/1072] 10.222.0.16 () {56 vars in 1205 bytes} [Tue Aug 10 04:59:34 2021] GET /identity/v3/domains/b6437cfd03c345b98ce78a382b5bbbee => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:59:34.372981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430732b-2da5-42e6-b983-aca184879694 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:34.381884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e430732b-2da5-42e6-b983-aca184879694 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:34.386345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629bbde-2c74-487f-8a41-8e0b40c05eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:34.387025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629bbde-2c74-487f-8a41-8e0b40c05eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:34.387307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629bbde-2c74-487f-8a41-8e0b40c05eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:34.387576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629bbde-2c74-487f-8a41-8e0b40c05eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:34.388280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629bbde-2c74-487f-8a41-8e0b40c05eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:34.390180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629bbde-2c74-487f-8a41-8e0b40c05eb9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:34.513871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 540/1073] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 04:59:34 2021] POST /identity/v3/users => generated 311 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 04:59:36.643339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388edd5a-84f7-43c9-a540-626dec9b2a7f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.643887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388edd5a-84f7-43c9-a540-626dec9b2a7f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.643887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388edd5a-84f7-43c9-a540-626dec9b2a7f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.645719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 534/1074] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:36.651441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.651877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.652000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.669694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:36.670899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:36.679051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 541/1075] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:36.702815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388edd5a-84f7-43c9-a540-626dec9b2a7f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:36.714894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388edd5a-84f7-43c9-a540-626dec9b2a7f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:36.719188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:36.719950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.720229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.720503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.731259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:36.737957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:36.739095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 535/1076] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:36.746052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:36.754776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477fa94-0efc-4f95-948a-9e7a4344b924 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:36.759292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:36.759942 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.760224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.760498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.761237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:36.761544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:36.763172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:36.771393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 542/1077] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:36.777629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:36.787962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eff38a-1556-4439-8231-4ab20961161d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:36.792409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:36.793268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.793550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.793833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] PATH_INFO: `/v3/users/599648bf33094450b64fa0ab0f945e19` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.808158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] RBAC: Authorizing `identity:get_user(user_id=599648bf33094450b64fa0ab0f945e19)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:36.810261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:36.811882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 536/1078] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:36 2021] GET /identity/v3/users/599648bf33094450b64fa0ab0f945e19 => generated 311 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:36.818097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:36.827532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826cc57-9919-4679-af93-56f66f95dce5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:36.831990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:36.832615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.832901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.833177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.840916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:36.842678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:36.851713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 543/1079] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:36.857723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:36.867564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b7281-c3d2-4ab8-b771-6dffc2822f1d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:36.871992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfe23a-0abe-439e-b881-9a9446560dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:36.872808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe23a-0abe-439e-b881-9a9446560dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.873085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe23a-0abe-439e-b881-9a9446560dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.873350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfe23a-0abe-439e-b881-9a9446560dc5 admin admin] PATH_INFO: `/v3/projects/9f6e917853f1431a905c5e4d0acd3de4` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.874481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe23a-0abe-439e-b881-9a9446560dc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f6e917853f1431a905c5e4d0acd3de4)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:36.876490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfe23a-0abe-439e-b881-9a9446560dc5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:36.878074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 537/1080] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:36 2021] GET /identity/v3/projects/9f6e917853f1431a905c5e4d0acd3de4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:36.884170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:36.892494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c3567-e7c6-4b46-91e6-52360757e9e0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:36.896928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:36.897538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:36.897823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:36.898100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:36.898940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=9f6e917853f1431a905c5e4d0acd3de4, user.id=599648bf33094450b64fa0ab0f945e19) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:36.899249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:36.901034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ef9c2-033a-4933-b047-ffc143d4e76a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:36.906125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 544/1081] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:36 2021] GET /identity/v3/role_assignments?user.id=599648bf33094450b64fa0ab0f945e19&scope.project.id=9f6e917853f1431a905c5e4d0acd3de4&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:38.965165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371d5d-6cdb-4f05-8cf1-aef286425eb7 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:38.965693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371d5d-6cdb-4f05-8cf1-aef286425eb7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:38.965693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de371d5d-6cdb-4f05-8cf1-aef286425eb7 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:38.967437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 538/1082] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:38.973208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:38.973599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:38.973789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:38.991650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:38.992832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:39.000371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 545/1083] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:39.025288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de371d5d-6cdb-4f05-8cf1-aef286425eb7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:39.037207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de371d5d-6cdb-4f05-8cf1-aef286425eb7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:39.041605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:39.042379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:39.042694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:39.042971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:39.052946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:39.059719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:39.060850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 539/1084] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:39.067181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:39.076303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56a650-4c3f-4f5d-bcaa-3677c7887515 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:39.080906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:39.081549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:39.081833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:39.082106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:39.082881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:39.083770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:39.085368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:39.093577 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 546/1085] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:39.099537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:39.108748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c7bae-ece1-4ead-8ec6-0fff518f4a76 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:39.113225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:39.114075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:39.114356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:39.114659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] PATH_INFO: `/v3/users/599648bf33094450b64fa0ab0f945e19` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:39.115828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] RBAC: Authorizing `identity:get_user(user_id=599648bf33094450b64fa0ab0f945e19)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:39.117958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:39.119525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 540/1086] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:39 2021] GET /identity/v3/users/599648bf33094450b64fa0ab0f945e19 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:39.125144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:39.134829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f3823-3eba-4ff4-aae9-6c2bc4cb9354 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:39.139276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34bb99-fef5-4ace-8330-34f9e6f8639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:39.140083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34bb99-fef5-4ace-8330-34f9e6f8639f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:39.140367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34bb99-fef5-4ace-8330-34f9e6f8639f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:39.140643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34bb99-fef5-4ace-8330-34f9e6f8639f admin admin] PATH_INFO: `/v3/projects/9f6e917853f1431a905c5e4d0acd3de4` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:39.141785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34bb99-fef5-4ace-8330-34f9e6f8639f admin admin] RBAC: Authorizing `identity:get_project(project_id=9f6e917853f1431a905c5e4d0acd3de4)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:39.143924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34bb99-fef5-4ace-8330-34f9e6f8639f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:39.145505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 547/1087] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:39 2021] GET /identity/v3/projects/9f6e917853f1431a905c5e4d0acd3de4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 04:59:39.151923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:39.161831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db2946-9c8a-4cb4-b455-19478c7aa758 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:39.166320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d47573-3e4b-4afa-82a7-0cd7ef902836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:39.167185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d47573-3e4b-4afa-82a7-0cd7ef902836 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:39.167467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d47573-3e4b-4afa-82a7-0cd7ef902836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:39.167739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d47573-3e4b-4afa-82a7-0cd7ef902836 admin admin] PATH_INFO: `/v3/projects/9f6e917853f1431a905c5e4d0acd3de4/users/599648bf33094450b64fa0ab0f945e19/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:39.169640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d47573-3e4b-4afa-82a7-0cd7ef902836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6e917853f1431a905c5e4d0acd3de4, user_id=599648bf33094450b64fa0ab0f945e19, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:39.172260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d47573-3e4b-4afa-82a7-0cd7ef902836 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:39.279801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 541/1088] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 04:59:39 2021] PUT /identity/v3/projects/9f6e917853f1431a905c5e4d0acd3de4/users/599648bf33094450b64fa0ab0f945e19/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 04:59:41.351993 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993d964-9dd6-484d-9809-959d0bef2cf2 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.352524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993d964-9dd6-484d-9809-959d0bef2cf2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.352524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993d964-9dd6-484d-9809-959d0bef2cf2 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.354297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 548/1089] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 04:59:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 04:59:41.360436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.360843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.360982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.378016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 04:59:41.379218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 04:59:41.432714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 542/1090] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 04:59:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 04:59:41.457293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993d964-9dd6-484d-9809-959d0bef2cf2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:41.469369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993d964-9dd6-484d-9809-959d0bef2cf2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:41.473635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:41.474426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.474733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.475006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.484818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 04:59:41.491919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 04:59:41.493028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 549/1091] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 04:59:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 04:59:41.499317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:41.508555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0549-ebef-481c-98b1-805f76f5ebda None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:41.513044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:41.513691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.513973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.514250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.515045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:41.515352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:41.516967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:41.525101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 543/1092] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 04:59:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:41.531521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:41.541843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20d4f-3c8b-4d37-b47d-76fce6a0e4d2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:41.546382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:41.547255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.547541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.547817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] PATH_INFO: `/v3/users/599648bf33094450b64fa0ab0f945e19` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.548985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] RBAC: Authorizing `identity:get_user(user_id=599648bf33094450b64fa0ab0f945e19)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:41.551146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:41.553221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 550/1093] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 04:59:41 2021] GET /identity/v3/users/599648bf33094450b64fa0ab0f945e19 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:41.559281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:41.569236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996dfb29-50f2-4d49-a689-e1b627a17e9f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:41.573736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:41.574360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.574678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.574958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.582485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:41.584313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:41.593224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 544/1094] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 04:59:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 04:59:41.599245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:41.608464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b64ce-e900-40f3-a22b-79a64e7fb2ab admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:41.612841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97366f-c56c-4a9c-bf38-18645544a8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:41.613649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97366f-c56c-4a9c-bf38-18645544a8cc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.613927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97366f-c56c-4a9c-bf38-18645544a8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.614198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97366f-c56c-4a9c-bf38-18645544a8cc admin admin] PATH_INFO: `/v3/projects/9f6e917853f1431a905c5e4d0acd3de4` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.615863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97366f-c56c-4a9c-bf38-18645544a8cc admin admin] RBAC: Authorizing `identity:get_project(project_id=9f6e917853f1431a905c5e4d0acd3de4)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:41.617854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97366f-c56c-4a9c-bf38-18645544a8cc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:41.619496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 551/1095] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 04:59:41 2021] GET /identity/v3/projects/9f6e917853f1431a905c5e4d0acd3de4 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 04:59:41.625678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 04:59:41.634689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c927-f0d5-4926-9b81-75f2a246d4b5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 04:59:41.639100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 04:59:41.639739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 04:59:41.640020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 04:59:41.640296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 04:59:41.641097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=9f6e917853f1431a905c5e4d0acd3de4, user.id=599648bf33094450b64fa0ab0f945e19) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 04:59:41.641404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 04:59:41.643240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837cd59-6038-4797-9a8d-2c9e013b92f7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 04:59:41.649243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 545/1096] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 04:59:41 2021] GET /identity/v3/role_assignments?user.id=599648bf33094450b64fa0ab0f945e19&scope.project.id=9f6e917853f1431a905c5e4d0acd3de4&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:50.667282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9bc0-6b67-4703-ae89-42b35cc8514d None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:50.667867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9bc0-6b67-4703-ae89-42b35cc8514d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:50.667867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb9bc0-6b67-4703-ae89-42b35cc8514d None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:50.669583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 552/1097] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:00:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:00:50.676484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:50.676484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:50.676484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:50.693266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:00:50.694438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:00:50.701949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 546/1098] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:00:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:00:50.728576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9bc0-6b67-4703-ae89-42b35cc8514d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:50.740559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb9bc0-6b67-4703-ae89-42b35cc8514d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:50.744908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:50.745679 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:50.745961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:50.746230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:50.756123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:50.757932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:50.775170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:50.776230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 553/1099] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 05:00:50.782904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:50.791779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cffa4-8326-4361-94a9-8fe4c553af29 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:50.796370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:50.798890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:50.798890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:50.798890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:50.798890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:50.798890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:50.800317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9accdbc6-0dfc-4780-a249-5cb1ecd435e6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:50.811177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 547/1100] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:50.817410 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:50.827403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c33a06-475b-4321-ab81-a1b0e4e7734d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:50.831976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3523e6d-b831-4d77-96d5-751d01ef15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:50.832840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523e6d-b831-4d77-96d5-751d01ef15b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:50.833125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523e6d-b831-4d77-96d5-751d01ef15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:50.833403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3523e6d-b831-4d77-96d5-751d01ef15b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:50.834130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523e6d-b831-4d77-96d5-751d01ef15b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:50.836128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3523e6d-b831-4d77-96d5-751d01ef15b5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:50.959978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 554/1101] 10.222.0.16 () {60 vars in 1154 bytes} [Tue Aug 10 05:00:50 2021] POST /identity/v3/users => generated 251 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:00:53.106908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db5ddd-0b58-4186-8596-8de3ebaa111e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.107478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db5ddd-0b58-4186-8596-8de3ebaa111e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.107478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db5ddd-0b58-4186-8596-8de3ebaa111e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.109235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 548/1102] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:00:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:00:53.115046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.115434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.115610 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.133724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:00:53.134937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:00:53.142487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 555/1103] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:00:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:00:53.167350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db5ddd-0b58-4186-8596-8de3ebaa111e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.179301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db5ddd-0b58-4186-8596-8de3ebaa111e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.184203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.184979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.185260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.185532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.195903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 05:00:53.203250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 05:00:53.204373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 549/1104] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:53.210678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.220524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf262fc5-e700-49ec-9f0b-e6a9084e36b6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.225056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.225705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.225982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.226252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.227016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:53.227350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.228925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.236914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 556/1105] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:00:53.243078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.252547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb48bc-f4ab-438b-a293-7f0526ec3961 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.257002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.257765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.258047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.258345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.268639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.270457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.287317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:53.288433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 550/1106] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:53.294550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.303844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d1856-f69d-47d1-82b5-02c4d4ff16d0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.308320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.308954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.309233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.309504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.310335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:53.310671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.312241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.324281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 557/1107] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:53.330451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.340933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f0c40-b17d-44c2-ade0-2f3660590b58 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.345898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.346724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.347012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.347290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.354433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.356502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.374658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 05:00:53.374658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 551/1108] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:53.378073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.388138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11f367-bcfa-4f20-b6f6-29f201b8535b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.392707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.393359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.393642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.393917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.394780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:53.395093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.396921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.414328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 558/1109] 10.222.0.16 () {56 vars in 1165 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:53.420401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.429903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf923d-b0fa-414a-99de-1b4eddc99978 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.434844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.435465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.435815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.436013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.443934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.445342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.454898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 552/1110] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:00:53.461585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.471817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88115708-ddff-4b8e-bd80-653f5f1670f3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.476389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.477162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.477445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.477717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.487773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.489596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.506262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:53.507498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 559/1111] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:53.513837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.523617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028785-3591-4304-a6c2-9546b5712343 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.528825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.529473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.529754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.530026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.530771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:53.531076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.532654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.544524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 553/1112] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:53.550728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.560389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b039-5478-4fa1-a5a9-2592afa509ee admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.564963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.565727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.566810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.566810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.573111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.575086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.588133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 05:00:53.589779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 560/1113] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:53.595629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.605503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17b3f-53fb-48b1-9a92-6a9dfe675814 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.610005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.610669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.610952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.611224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.611987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:53.612293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.614090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e8448-84c8-4468-a8ff-cdd8a5ee7aba admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.625802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 554/1114] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:53.632299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:53.642381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b6b16-924d-46d3-947e-14e0371bc86e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:53.647212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:53.647569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:53.647850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:53.648124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:53.648935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=bb96e345c35042f89d5bc2c671113655) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:53.649733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:53.651581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a811c-9456-47a1-8e97-73a83a8503e0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:53.656723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 561/1115] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 05:00:53 2021] GET /identity/v3/role_assignments?user.id=bb96e345c35042f89d5bc2c671113655&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:55.762359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493857e3-3017-4e8f-bf0e-93dce9ba32c9 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:55.762950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493857e3-3017-4e8f-bf0e-93dce9ba32c9 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:55.762950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493857e3-3017-4e8f-bf0e-93dce9ba32c9 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:55.764729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 555/1116] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:00:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:00:55.770433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:55.770902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:55.771017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:55.788031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:00:55.789150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:00:55.796686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 562/1117] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:00:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:00:55.820809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493857e3-3017-4e8f-bf0e-93dce9ba32c9 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:55.833494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493857e3-3017-4e8f-bf0e-93dce9ba32c9 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:55.837932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:55.838752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:55.839038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:55.841616 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:55.849552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 05:00:55.856531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 05:00:55.857666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 556/1118] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 05:00:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:55.864194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:55.873498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a302-9c42-46c1-91df-82667bd53d8b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:55.878493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:55.878753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:55.878846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:55.879119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:55.879848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] RBAC: Adding query filter params (name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:55.880151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:55.881719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:55.890110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 563/1119] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 05:00:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:55.896302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:55.907187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0db4e-ebb0-4d63-987a-6a0b05f208e3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:55.911708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:55.912527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:55.912815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:55.913091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:55.923166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:55.924995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:55.941792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:55.942955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 557/1120] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:55.949784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:55.959126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a9e43-6ec2-4792-831d-c92251ecbd0f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:55.963746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:55.964454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:55.964732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:55.965000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:55.965707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:55.966008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:55.967606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:55.979352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 564/1121] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:55.985344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:55.995465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5da9cb-d2b8-4130-a222-5c252913a3be admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:55.999984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.000757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.001041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.001318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.008555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.010566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.024265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 05:00:56.025383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 558/1122] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:55 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:56.031451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:56.041787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65104974-5ead-4a4d-aad1-6de8285d27a2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:56.046359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.047039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.047326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.047602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.048430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:56.048739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.050571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.067873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 565/1123] 10.222.0.16 () {56 vars in 1165 bytes} [Tue Aug 10 05:00:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:56.073706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:56.083258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822a1e8-6501-4675-a0bb-188b43beaf8d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:56.087852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.088620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.088904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.089179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.099480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.101309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.119637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:56.120746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 559/1124] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:56.126774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:56.136200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fc77a-b5bd-4103-90fe-b975e60b75fa admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:56.140674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.141336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.141615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.141882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.142597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:56.142910 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.144462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.155320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 566/1125] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:56.161270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:56.171270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaaed2-59a5-4463-aa58-18ec1275999e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:56.175893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.176665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.176945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.181087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.184588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.186527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.199346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 05:00:56.200475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 560/1126] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 05:00:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:56.206763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:56.216444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002a4fb-94c4-4b9a-9d29-2f61bae03d5e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:56.221247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.221990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.222275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.222551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.223358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:56.223667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.225494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1427c8-7be7-401f-a137-deced478c3de admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.237703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 567/1127] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 05:00:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:56.244742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:56.254966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f2387-29ad-45f4-b68a-69a713ef39b6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:56.259557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4b15-0d5f-43d2-9a53-82878aa815d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:56.260413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4b15-0d5f-43d2-9a53-82878aa815d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:56.260696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4b15-0d5f-43d2-9a53-82878aa815d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:56.260970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4b15-0d5f-43d2-9a53-82878aa815d5 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/bb96e345c35042f89d5bc2c671113655/roles/661315ffc5a040a996976997e234726f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:56.274856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4b15-0d5f-43d2-9a53-82878aa815d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=bb96e345c35042f89d5bc2c671113655, role_id=661315ffc5a040a996976997e234726f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:56.277487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4b15-0d5f-43d2-9a53-82878aa815d5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:56.337182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 561/1128] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 05:00:56 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/bb96e345c35042f89d5bc2c671113655/roles/661315ffc5a040a996976997e234726f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:00:58.423670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318846-778d-4bd7-bf4c-c49562afdb5c None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.424233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318846-778d-4bd7-bf4c-c49562afdb5c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.424233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac318846-778d-4bd7-bf4c-c49562afdb5c None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.425994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 568/1129] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:00:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:00:58.431834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.432287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.432382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.450357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:00:58.451615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:00:58.507008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 562/1130] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:00:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:00:58.532549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac318846-778d-4bd7-bf4c-c49562afdb5c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.544963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac318846-778d-4bd7-bf4c-c49562afdb5c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.550268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.551090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.551367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.551638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.561892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 05:00:58.570493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 10 05:00:58.572379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 569/1131] 10.222.0.16 () {56 vars in 1124 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:58.578789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.588558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4cddb-18cd-4afd-b6e4-ec8af8c8e05d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.593289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.593946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.594227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.594784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.595526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] RBAC: Adding query filter params (name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:58.595827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.597410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.605339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 563/1132] 10.222.0.16 () {56 vars in 1125 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:58.611470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.621697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed97d0-4ce6-43e2-8bc9-65b4cd0486eb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.626296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.627189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.634099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.634099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.638113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.639978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.657204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:58.658306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 570/1133] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 05:00:58.664509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.674155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb60fd-0834-4b49-a9bc-96ed5028b17b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.678731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.679384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.679771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.680054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.681285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:58.681588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.683201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.694529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 564/1134] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:58.700687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.710120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a032c4-d55f-4e19-908b-3627c8b92e4f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.715243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.716016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.716295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.716563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.723843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.725877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.740308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 05:00:58.741435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 571/1135] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:58.748033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.757636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baaaab-7020-496a-9545-65b1a1b3349b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.762196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.762885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.763170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.763445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.764265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:58.764573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.766392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.783571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 565/1136] 10.222.0.16 () {56 vars in 1165 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:58.789754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.799896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5628-c2c7-40be-a54c-e6d6b89f72dd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.804641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.805265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.805557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.805835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.813471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.815293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.824371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 572/1137] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:00:58.830491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.840508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446e8a3-281e-4b07-8797-144a47c86821 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.845670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.846495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.846804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.847080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.857933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.859790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.876184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:00:58.877311 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 566/1138] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:00:58.883520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.892197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bf39d-a3b9-46b2-9126-088f6b058618 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.896831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.897472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.897753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.898028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.898782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:58.899090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.901148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.912084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 573/1139] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:00:58.918556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.928102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9dbec-f199-4ab4-b83a-a0b4b23fda85 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.932507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.933267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.933544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.933813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.940440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.942354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.954993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 05:00:58.956087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 567/1140] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 05:00:58.962866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:58.972453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ae55-f7a2-41cf-a5f2-0bef8b29d0dc admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:58.977016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:58.978180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:58.978459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:58.978766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:58.979561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:58.979868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:58.981683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac85959-c00f-4ab8-9b7a-dc6334959f3a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:58.993663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 574/1141] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:00:59.000600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:00:59.011013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8635aa7-dfcc-4ee8-a678-95d054a56129 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:00:59.015453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:00:59.016069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:00:59.016347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:00:59.016614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:00:59.017420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] RBAC: Adding query filter params (role.id=661315ffc5a040a996976997e234726f, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=bb96e345c35042f89d5bc2c671113655) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:00:59.017730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:00:59.019655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e18fd1-6da0-4a83-af5f-fdc5b0990571 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:00:59.025706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 568/1142] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 05:00:58 2021] GET /identity/v3/role_assignments?user.id=bb96e345c35042f89d5bc2c671113655&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=661315ffc5a040a996976997e234726f => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:01.188536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f5654-555a-498e-a970-8600eef38372 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.189067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f5654-555a-498e-a970-8600eef38372 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.189158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f5654-555a-498e-a970-8600eef38372 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.190901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 575/1143] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:01.196930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.197315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.197481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.215107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:01.216306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:01.224158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:01.248337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f5654-555a-498e-a970-8600eef38372 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.261037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f5654-555a-498e-a970-8600eef38372 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.265481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.266250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.266532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.266838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.277594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 05:01:01.284344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 05:01:01.285504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 576/1145] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:01.291958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.300919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959148f-b848-4902-bec9-309d4a04d8df None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.305492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.306145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.306435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.306751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.307499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:01.307805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.309386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.317542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 570/1146] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:01.324272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.333749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6637f-fd41-43b3-b4fc-d51728595a73 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.338900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.339663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.339945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.340218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.351069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.358120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.368625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:01:01.369750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 577/1147] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:01.375993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.386246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76683b57-0c17-49d8-a144-d7cbaae857a2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.390902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.391548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.391834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.392110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.392823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:01.393181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.394787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.406375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 571/1148] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:01.412429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.422370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5e098-aa59-4f2b-b0a6-16df0957f071 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.426862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.427672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.438763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.438763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.438763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.438763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.451464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 05:01:01.452578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 578/1149] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:01.458965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.471347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5132f-16c5-47b3-b3af-ab0098b590a0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.476006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.476656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.476934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.477203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.478050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:01.478353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.480346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.497150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 572/1150] 10.222.0.16 () {56 vars in 1165 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:01:01.503704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.513728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366624b-030f-460d-b7c3-24ed321fd439 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.518258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.518922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.519201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.519470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.527719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.529451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.538160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 579/1151] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:01:01.544405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.554088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28ffb6-5c04-4050-8b08-8e09fe8663ab admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.558713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.559490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.559767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.560029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.569983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.572356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.589117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:01:01.590231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 573/1152] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:01.597238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.606011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeb695-8db7-4277-9fff-4682c250b643 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.610525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.611190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.611471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.611740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.612443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:01.612742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.614305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.626177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 580/1153] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:01:01.632181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.642247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2839905-b22c-48e0-bbce-b540aa1a7f8a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.646902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.647678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.647956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.648236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.655543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.657550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.670338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 05:01:01.671476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 574/1154] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:01.677759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.687810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0b0d7-8975-4da6-a034-eb29cdb3e17e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.692386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.692973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.693255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.693529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.694323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:01.694645 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.697122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631088aa-b7ad-4fe1-a5f8-c640a55fcb8d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.708284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 581/1155] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:01.715454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:01.727336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e24f3-76cc-40eb-a003-df0e197f5f0d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:01.732069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:01.732774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:01.733055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:01.733353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:01.734154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=bb96e345c35042f89d5bc2c671113655) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:01.734461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:01.736383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e164b422-262a-4efa-bcc9-2a7f92779eec admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:01.741990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 575/1156] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 05:01:01 2021] GET /identity/v3/role_assignments?user.id=bb96e345c35042f89d5bc2c671113655&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:03.831258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82756d60-1932-4daf-a658-5422e7564e36 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:03.831784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82756d60-1932-4daf-a658-5422e7564e36 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:03.831784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82756d60-1932-4daf-a658-5422e7564e36 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:03.833479 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 582/1157] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:03.840161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:03.840617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:03.840719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:03.858243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:03.859458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:03.867356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 576/1158] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:03 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:03.891503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82756d60-1932-4daf-a658-5422e7564e36 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:03.904032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82756d60-1932-4daf-a658-5422e7564e36 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:03.908370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:03.909136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:03.909417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:03.909694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:03.920051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 05:01:03.926784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 05:01:03.927976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 583/1159] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 05:01:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:03.935382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:03.944550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378c1e7-131f-4ff4-ab7f-4ebf2bc70621 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:03.949865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:03.952482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:03.952482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:03.952482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:03.952482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:03.952482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:03.953728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:03.961945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 577/1160] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 05:01:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:03.968387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:03.978824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985219fb-1fc3-45e0-93d0-13621666d869 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:03.983384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:03.984140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:03.984415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:03.984682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:03.995107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:03.996916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.013901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:01:04.015047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 584/1161] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:04.021349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.031090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a24f20-2bdd-4178-8766-d8f5b69f157f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.035560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.038777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.038777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.038777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.038777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:04.038777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.040074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.051122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 578/1162] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:04.058009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.067936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760f26b-ad80-4a56-ae6a-7af124249656 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.073092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.073862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.074139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.074409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.081566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.083530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.097219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 05:01:04.098326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 585/1163] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:04.104650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.114118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68397e1-dad8-4cd2-b0b3-1ae41e60183a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.119094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.124842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.124842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.124842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.124842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:04.124842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.124842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.140176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 579/1164] 10.222.0.16 () {56 vars in 1165 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:01:04.146177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.155950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14f3db-b16e-4baa-8ec0-adbf21db4ad1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.160650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.161430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.164951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.164951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.172126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.173957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.190793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:01:04.191948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 586/1165] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:04.198864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.208576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff91e5-fc8a-4ba3-a8bc-8d01a04a2323 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.213241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.213891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.214177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.214453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.215225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:04.222318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.222318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.228476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 580/1166] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:04.234445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.244543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd73f21-b6df-4f32-b467-1d9025651525 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.249064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.249832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.250148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.250427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.257350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.259887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.272373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 05:01:04.273496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 587/1167] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:04.279758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.291471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c3b39-aefc-4e70-88ff-d0200a798f9f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.296520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.297257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.297584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.297905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.298822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:04.299178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.301150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf335b3-efc8-48f1-aedb-3902be1886e1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.313697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 581/1168] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 05:01:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:04.320226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:04.330538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb8a9-9f0a-4ac1-b74f-4f0908967bcd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:04.335159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f8e129-5c3f-4cbc-b0ab-731c55499026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:04.335965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8e129-5c3f-4cbc-b0ab-731c55499026 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:04.336245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8e129-5c3f-4cbc-b0ab-731c55499026 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:04.336517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f8e129-5c3f-4cbc-b0ab-731c55499026 admin admin] PATH_INFO: `/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/bb96e345c35042f89d5bc2c671113655/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:04.338440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8e129-5c3f-4cbc-b0ab-731c55499026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ba4c23e0e443718dc607bd31d4a374, user_id=bb96e345c35042f89d5bc2c671113655, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:04.341105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f8e129-5c3f-4cbc-b0ab-731c55499026 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:04.417886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 588/1169] 10.222.0.16 () {58 vars in 1461 bytes} [Tue Aug 10 05:01:04 2021] PUT /identity/v3/projects/13ba4c23e0e443718dc607bd31d4a374/users/bb96e345c35042f89d5bc2c671113655/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:01:06.500082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457051e3-72f7-4305-8f54-f32907d3a07f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.500642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457051e3-72f7-4305-8f54-f32907d3a07f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.500642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457051e3-72f7-4305-8f54-f32907d3a07f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.502475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 582/1170] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:06.508936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.511562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.511562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.528375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:06.537053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:06.585512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 589/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:06.611158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457051e3-72f7-4305-8f54-f32907d3a07f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.623934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457051e3-72f7-4305-8f54-f32907d3a07f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.628513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.629296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.629575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.629847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.639981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 10 05:01:06.646774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 10 05:01:06.647953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 583/1172] 10.222.0.16 () {56 vars in 1118 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:06.654420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.663214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b20b5e-395b-4ae0-bc7b-913de0dd344f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.668404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.669047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.669326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.669601 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.670335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:06.670672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.672264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.680266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 590/1173] 10.222.0.16 () {56 vars in 1121 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:06.686935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.696934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e284a0a-f353-43f9-83bd-72c4ca000192 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.701414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.702168 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.702445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.702743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.712616 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.714422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.731236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:01:06.732349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 584/1174] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 10 05:01:06.738790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.749017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357551a6-60a9-4d5c-bfef-679abc989c39 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.753690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.754275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.754560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.754866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.755579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:06.755887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.757509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.770006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 591/1175] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:06.776823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.786520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb59f6-2b8b-4230-a53a-862a4574ea37 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.791467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.792279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.792555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.792824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.800525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.802602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.817047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 10 05:01:06.818189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 585/1176] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:06.824515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.834454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac0c6e-7743-4cf0-8107-af0d13251398 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.839403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.840063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.840345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.840616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.841444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:06.841753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.843745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.862450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 592/1177] 10.222.0.16 () {56 vars in 1165 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:06.869404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.879096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a930b48c-758a-43d4-b2ea-eb7958bb8f47 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.883757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.884383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.884662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.884933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.892930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.894741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.904641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 586/1178] 10.222.0.16 () {58 vars in 1325 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:01:06.911446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.921737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30442a2c-fec0-4ad5-b66e-b3f5e4ffeb2f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.926446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.927254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.927588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.927927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.938069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.939931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.956429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 10 05:01:06.957604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 593/1179] 10.222.0.16 () {56 vars in 1130 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:06.964769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:06.973993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480d51c-b83f-4968-b750-7fae04399715 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:06.979340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:06.979987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:06.980321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:06.980594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:06.981299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:06.981599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:06.983198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:06.994087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 587/1180] 10.222.0.16 () {56 vars in 1131 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:07.000288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:07.009900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30be6e0-b855-4c0c-97c0-80338e7d6b1b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:07.014379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:07.015226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:07.016247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:07.016247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:07.022725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:07.025186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:07.037845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING keystone.server.flask.application [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 10 05:01:07.038985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 594/1181] 10.222.0.16 () {56 vars in 1133 bytes} [Tue Aug 10 05:01:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:07.045732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:07.055138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39388bf9-22a3-4a71-9c38-7f9c517d444d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:07.059956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:07.060646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:07.060924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:07.061198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:07.062236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:07.062376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:07.064237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aed2a-1f70-4ea0-88d3-ac80216f7da4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:07.076218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 588/1182] 10.222.0.16 () {56 vars in 1170 bytes} [Tue Aug 10 05:01:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:07.082652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:07.093390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d99251-60d7-43c4-be34-abb483a47497 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:07.098198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:07.098859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:07.099140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:07.099409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:07.100222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] RBAC: Adding query filter params (role.id=feeee1c6999f4a39acea8001cebf6fec, scope.project.id=13ba4c23e0e443718dc607bd31d4a374, user.id=bb96e345c35042f89d5bc2c671113655) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:07.100529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:07.102530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95afefc-b596-4ac6-93cd-ceba419041a5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:07.109036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 595/1183] 10.222.0.16 () {56 vars in 1396 bytes} [Tue Aug 10 05:01:07 2021] GET /identity/v3/role_assignments?user.id=bb96e345c35042f89d5bc2c671113655&scope.project.id=13ba4c23e0e443718dc607bd31d4a374&role.id=feeee1c6999f4a39acea8001cebf6fec => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:09.261208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbcf0b-8721-46e4-81f4-72119e09c8e1 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:09.261770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbcf0b-8721-46e4-81f4-72119e09c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:09.261867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbcf0b-8721-46e4-81f4-72119e09c8e1 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:09.263653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 589/1184] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:09.269421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:09.269881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:09.270158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:09.288145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:09.289365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:09.297793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 596/1185] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:09.320958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbcf0b-8721-46e4-81f4-72119e09c8e1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:09.334359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbcf0b-8721-46e4-81f4-72119e09c8e1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:09.340225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:09.341058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:09.341420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:09.341750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:09.342396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:09.344021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:09.355863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 05:01:09.356999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 590/1186] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 05:01:09 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:09.363518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:09.372319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6312f6d-f192-4d7d-9d75-19c64b4a6bbb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:09.376776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:09.377413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:09.377693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:09.377968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:09.378717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:09.379024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:09.380607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786460e-31fe-447f-ba4d-ba9e843a02f1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:09.385214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 597/1187] 10.222.0.16 () {56 vars in 1138 bytes} [Tue Aug 10 05:01:09 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:09.391304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:09.401278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f2fef-76b9-4f98-9734-764e675bd8f4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:09.405811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:09.406446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:09.406766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:09.407045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] PATH_INFO: `/v3/services` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:09.407739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:09.408045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:09.409611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29b9d2-a1a0-4ea0-9764-dfd8eae0b452 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:09.413869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 591/1188] 10.222.0.16 () {56 vars in 1138 bytes} [Tue Aug 10 05:01:09 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:01:11.529678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808610d-3e3a-48f4-86a4-647794fb901f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:11.530109 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808610d-3e3a-48f4-86a4-647794fb901f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:11.530221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808610d-3e3a-48f4-86a4-647794fb901f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:11.532061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 598/1189] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:11.538020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40c2a-219c-44e2-9c24-6953b255a337 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:11.538402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40c2a-219c-44e2-9c24-6953b255a337 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:11.538603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf40c2a-219c-44e2-9c24-6953b255a337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:11.556491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6bf40c2a-219c-44e2-9c24-6953b255a337 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:11.557659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6bf40c2a-219c-44e2-9c24-6953b255a337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:11.565186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 592/1190] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:11.589443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808610d-3e3a-48f4-86a4-647794fb901f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:11.601979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808610d-3e3a-48f4-86a4-647794fb901f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:11.607068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a904f-3c63-4c61-8a72-94a103113868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:11.613442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a904f-3c63-4c61-8a72-94a103113868 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:11.613442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a904f-3c63-4c61-8a72-94a103113868 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:11.613442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a904f-3c63-4c61-8a72-94a103113868 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:11.613442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a904f-3c63-4c61-8a72-94a103113868 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:11.613442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a904f-3c63-4c61-8a72-94a103113868 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:11.743189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 599/1191] 10.222.0.16 () {60 vars in 1163 bytes} [Tue Aug 10 05:01:11 2021] POST /identity/v3/services => generated 246 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:01:13.887048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722e3e8-6e0c-4291-b36d-4a5fe9884398 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:13.887560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722e3e8-6e0c-4291-b36d-4a5fe9884398 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:13.887560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722e3e8-6e0c-4291-b36d-4a5fe9884398 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:13.889301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 593/1192] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:13.895409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:13.895821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:13.895958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:13.913631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:13.914842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:13.931768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 600/1193] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:13.956436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722e3e8-6e0c-4291-b36d-4a5fe9884398 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:13.968501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722e3e8-6e0c-4291-b36d-4a5fe9884398 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:13.973217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:13.973999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:13.974276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:13.974543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:13.975212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:13.976820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:13.987722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 05:01:13.988855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 594/1194] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 05:01:13 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:13.996140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:14.004933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ab4e4-f426-4f98-8591-6f8fd8c54e5b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:14.009950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:14.010656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:14.010936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:14.011208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:14.011896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:14.012201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:14.013788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:14.018932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 601/1195] 10.222.0.16 () {56 vars in 1138 bytes} [Tue Aug 10 05:01:13 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:14.025533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:14.035414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb75e8-8455-41da-9080-5adfb9e32d9b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:14.039854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:14.041008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:14.041286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:14.041552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:14.042317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] RBAC: Adding query filter params (interface=public, service_id=a6494f9351134da2ae01838be35ce6f8, region_id=RegionOne) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:14.042654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:14.044229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba30d00-886c-4bf5-b914-99ffbd8602d6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:14.049063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 595/1196] 10.222.0.16 () {56 vars in 1273 bytes} [Tue Aug 10 05:01:14 2021] GET /identity/v3/endpoints?service_id=a6494f9351134da2ae01838be35ce6f8&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:01:14.054985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:14.065182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496099bd-b4b9-4256-b4cd-bc304875ffe5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:14.069906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a599-febf-47ae-997b-00872f18d051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:14.079111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a599-febf-47ae-997b-00872f18d051 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:14.079111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a599-febf-47ae-997b-00872f18d051 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:14.079111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a599-febf-47ae-997b-00872f18d051 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:14.079111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a599-febf-47ae-997b-00872f18d051 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:14.079111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a599-febf-47ae-997b-00872f18d051 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:14.080178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 602/1197] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 05:01:14 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:01:16.214975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd335-82eb-4b70-8735-ec709dae7947 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:16.215524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd335-82eb-4b70-8735-ec709dae7947 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:16.215524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ecd335-82eb-4b70-8735-ec709dae7947 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:16.217425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 596/1198] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:01:16.223429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:16.223828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:16.223976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:16.241198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:01:16.242445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:01:16.250519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 603/1199] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:01:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:01:16.274770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd335-82eb-4b70-8735-ec709dae7947 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:16.286817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ecd335-82eb-4b70-8735-ec709dae7947 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:16.297303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:16.297303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:16.297303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:16.297303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] PATH_INFO: `/v3/services/placement` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:16.297721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:16.297721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:16.307237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING keystone.server.flask.application [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 10 05:01:16.308361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 597/1200] 10.222.0.16 () {56 vars in 1139 bytes} [Tue Aug 10 05:01:16 2021] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 10 05:01:16.314950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:16.323846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0680681-2b91-44c8-a9e4-5e2885b5e036 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:16.328435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:16.329074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:16.329389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:16.329658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] PATH_INFO: `/v3/services` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:16.330351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:01:16.330766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:16.332374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43079e3-47b1-41ca-80ac-bb2c8f101bd0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:16.337264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 604/1201] 10.222.0.16 () {56 vars in 1138 bytes} [Tue Aug 10 05:01:16 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:01:16.343219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:01:16.353897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95be7be-782b-4403-9c0d-3744dd843fdc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:01:16.358517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9612a8d-ee92-4b0d-8f37-a0a223261fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:01:16.359172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612a8d-ee92-4b0d-8f37-a0a223261fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:01:16.359454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612a8d-ee92-4b0d-8f37-a0a223261fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:01:16.359729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9612a8d-ee92-4b0d-8f37-a0a223261fe8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:01:16.360452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612a8d-ee92-4b0d-8f37-a0a223261fe8 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:01:16.362012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9612a8d-ee92-4b0d-8f37-a0a223261fe8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:01:16.455507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 598/1202] 10.222.0.16 () {60 vars in 1166 bytes} [Tue Aug 10 05:01:16 2021] POST /identity/v3/endpoints => generated 331 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:07:26.285353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f574ee-985b-4301-84cc-247be845d5a7 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:26.285823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f574ee-985b-4301-84cc-247be845d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:26.286325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f574ee-985b-4301-84cc-247be845d5a7 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:26.293671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 605/1203] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:26.296094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e23187-24f9-4b48-8320-189495e0d31c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:26.296835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e23187-24f9-4b48-8320-189495e0d31c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:26.297261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e23187-24f9-4b48-8320-189495e0d31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:26.435440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-59e23187-24f9-4b48-8320-189495e0d31c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:26.437003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-59e23187-24f9-4b48-8320-189495e0d31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:26.545140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 599/1204] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:26.569519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f574ee-985b-4301-84cc-247be845d5a7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:26.571495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b8f574ee-985b-4301-84cc-247be845d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:26.705788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f574ee-985b-4301-84cc-247be845d5a7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:26.795838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e86cdd-aecb-44ae-9f0a-11e8157d42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:26.796680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e86cdd-aecb-44ae-9f0a-11e8157d42f7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:26.797062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e86cdd-aecb-44ae-9f0a-11e8157d42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:26.797438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e86cdd-aecb-44ae-9f0a-11e8157d42f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:26.798281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e86cdd-aecb-44ae-9f0a-11e8157d42f7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:26.800324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e86cdd-aecb-44ae-9f0a-11e8157d42f7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:26.819305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 606/1205] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 05:07:26 2021] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:07:28.978208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b16e-038f-4f87-b440-6050290645f2 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:28.978803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b16e-038f-4f87-b440-6050290645f2 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:28.978803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3b16e-038f-4f87-b440-6050290645f2 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:28.980568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 600/1206] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:28.987080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9baf3-e62a-495e-847c-d0b3d27a0ea0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:28.987475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9baf3-e62a-495e-847c-d0b3d27a0ea0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:28.987631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9baf3-e62a-495e-847c-d0b3d27a0ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:29.055088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ede9baf3-e62a-495e-847c-d0b3d27a0ea0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:29.056303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ede9baf3-e62a-495e-847c-d0b3d27a0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:29.149213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 607/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:29.200424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a0683-b997-42de-9d00-2070f7ff9bdc None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:29.200713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a0683-b997-42de-9d00-2070f7ff9bdc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:29.200992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a0683-b997-42de-9d00-2070f7ff9bdc None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:29.202791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 601/1208] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 10 05:07:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:29.208920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc584-ae3f-4bed-b4da-90892c2887c1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:29.209213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc584-ae3f-4bed-b4da-90892c2887c1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:29.209486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73bc584-ae3f-4bed-b4da-90892c2887c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:29.280858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c73bc584-ae3f-4bed-b4da-90892c2887c1 None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:29.282075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c73bc584-ae3f-4bed-b4da-90892c2887c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:29.358706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 608/1209] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 10 05:07:29 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:07:29.368471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a0683-b997-42de-9d00-2070f7ff9bdc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:29.370077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-123a0683-b997-42de-9d00-2070f7ff9bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:29.475293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a0683-b997-42de-9d00-2070f7ff9bdc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:29.546429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:29.547046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:29.547329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:29.547605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:29.549322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:29.651344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:29.652801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afc19a-de23-48f3-82ad-f4ea9dabd4f0 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:29.670692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 602/1210] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:32.020829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1498-453f-427d-875f-244cc84bdb2d None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:32.021360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1498-453f-427d-875f-244cc84bdb2d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:32.021473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b1498-453f-427d-875f-244cc84bdb2d None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:32.023313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 609/1211] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:32.029306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f909a7-2d4e-4836-a4fc-fec561dc1e7d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:32.029705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f909a7-2d4e-4836-a4fc-fec561dc1e7d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:32.029872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f909a7-2d4e-4836-a4fc-fec561dc1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:32.093710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-97f909a7-2d4e-4836-a4fc-fec561dc1e7d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:32.094940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-97f909a7-2d4e-4836-a4fc-fec561dc1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:32.187065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 603/1212] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:32.226407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1498-453f-427d-875f-244cc84bdb2d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:32.227953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cf2b1498-453f-427d-875f-244cc84bdb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:32.326409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b1498-453f-427d-875f-244cc84bdb2d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:32.395380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:32.396013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:32.396295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:32.396566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:32.398148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:32.515034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:32.516771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ae3f8-397a-4c4b-b3be-33953ec8aa8b service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:32.536418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 610/1213] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:35.169544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fb335-9234-4a19-91f7-bdd14b504ce6 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:35.170083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fb335-9234-4a19-91f7-bdd14b504ce6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:35.170276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fb335-9234-4a19-91f7-bdd14b504ce6 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:35.171948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 604/1214] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:35.178277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:35.178746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:35.178944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:35.240656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:35.241867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:35.332689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 611/1215] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:35.367742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fb335-9234-4a19-91f7-bdd14b504ce6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:35.369235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fa1fb335-9234-4a19-91f7-bdd14b504ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:35.486179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fb335-9234-4a19-91f7-bdd14b504ce6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:35.574469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7702-45ff-4bdb-b10c-9ccfd835f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:35.575353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7702-45ff-4bdb-b10c-9ccfd835f616 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:35.575631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7702-45ff-4bdb-b10c-9ccfd835f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:35.575898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7702-45ff-4bdb-b10c-9ccfd835f616 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:35.585890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7702-45ff-4bdb-b10c-9ccfd835f616 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:35.587964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7702-45ff-4bdb-b10c-9ccfd835f616 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:35.589631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 605/1216] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:07:35 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:07:35.602502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:35.603723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:35.691772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe549f8d-03ba-4001-bf4c-119339d80fc1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:35.760924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:35.761582 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:35.761862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:35.762134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:35.763748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:35.866364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:35.867829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc3cda-898c-4ef6-8697-ececf5b594af service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:35.885206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 612/1217] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:38.857699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7666-e8c1-4702-96ee-57b7c3c7e030 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:38.858206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7666-e8c1-4702-96ee-57b7c3c7e030 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:38.858206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae7666-e8c1-4702-96ee-57b7c3c7e030 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:38.859944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 606/1218] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:38.865811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:38.866210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:38.866377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:38.928464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:38.929668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:39.021954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 613/1219] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:39.055456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae7666-e8c1-4702-96ee-57b7c3c7e030 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:39.056997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0eae7666-e8c1-4702-96ee-57b7c3c7e030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:39.175527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae7666-e8c1-4702-96ee-57b7c3c7e030 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:39.264446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f238502-8b06-4728-9df9-85707aa149cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:39.265291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238502-8b06-4728-9df9-85707aa149cd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:39.265569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238502-8b06-4728-9df9-85707aa149cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:39.265841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f238502-8b06-4728-9df9-85707aa149cd admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:39.275857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238502-8b06-4728-9df9-85707aa149cd admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:39.277912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f238502-8b06-4728-9df9-85707aa149cd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:39.279849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 607/1220] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:07:39 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:07:39.292153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:39.293348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:39.380680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812238d-5bbf-4842-bbe6-c41b66ed499e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:39.450253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:39.450870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:39.451154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:39.451430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:39.453020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:39.555521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:39.556989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617cc02-63a6-447c-9c77-59d158b08130 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:39.574694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 614/1221] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:42.697928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4671-05ad-48a5-9d78-86f231de85c0 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:42.698508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4671-05ad-48a5-9d78-86f231de85c0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:42.698508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c4671-05ad-48a5-9d78-86f231de85c0 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:42.700278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 608/1222] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:42.706132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603c0d6-71d6-4781-b034-3ef77fd9e18b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:42.706632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603c0d6-71d6-4781-b034-3ef77fd9e18b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:42.706784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603c0d6-71d6-4781-b034-3ef77fd9e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:42.771294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4603c0d6-71d6-4781-b034-3ef77fd9e18b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:42.772554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4603c0d6-71d6-4781-b034-3ef77fd9e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:42.869841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 615/1223] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:42.924044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305496-aa22-486b-b47f-05f87f318646 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:42.924342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305496-aa22-486b-b47f-05f87f318646 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:42.924618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305496-aa22-486b-b47f-05f87f318646 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:42.926395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 609/1224] 10.222.0.16 () {54 vars in 964 bytes} [Tue Aug 10 05:07:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:07:42.933350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292f05-db8e-47e6-8090-bbf4882d127b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:42.933642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292f05-db8e-47e6-8090-bbf4882d127b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:42.933923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1292f05-db8e-47e6-8090-bbf4882d127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:43.010678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a1292f05-db8e-47e6-8090-bbf4882d127b None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:43.011877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a1292f05-db8e-47e6-8090-bbf4882d127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:43.086716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 616/1225] 10.222.0.16 () {58 vars in 1062 bytes} [Tue Aug 10 05:07:42 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:43.097450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61305496-aa22-486b-b47f-05f87f318646 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:43.099064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-61305496-aa22-486b-b47f-05f87f318646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:43.197911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61305496-aa22-486b-b47f-05f87f318646 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:43.268836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:43.269486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:43.269762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:43.270026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:43.271645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:43.376376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:43.377741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416d8db-1d0e-41dd-8ea7-b2f39089ca68 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:43.395771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 610/1226] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:45.774876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb579ae-8140-44dc-99b8-6636ce9a2a48 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:45.775399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb579ae-8140-44dc-99b8-6636ce9a2a48 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:45.775399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb579ae-8140-44dc-99b8-6636ce9a2a48 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:45.777133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 617/1227] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:45.783566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66dc6d-b78e-415e-a755-02f227724a61 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:45.783988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66dc6d-b78e-415e-a755-02f227724a61 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:45.784158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b66dc6d-b78e-415e-a755-02f227724a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:45.846668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7b66dc6d-b78e-415e-a755-02f227724a61 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:45.847858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7b66dc6d-b78e-415e-a755-02f227724a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:45.938818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 611/1228] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:45.976313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb579ae-8140-44dc-99b8-6636ce9a2a48 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:45.977850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4bb579ae-8140-44dc-99b8-6636ce9a2a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:46.077467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb579ae-8140-44dc-99b8-6636ce9a2a48 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:46.148125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:46.148768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:46.149045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:46.149313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:46.150925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:46.259487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:46.260916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae2463-7761-4c91-b8fa-00caacd05c70 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:46.278672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 618/1229] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:48.487047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e0da8-ffdd-4b35-a7cc-385baba43e8e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:48.487539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e0da8-ffdd-4b35-a7cc-385baba43e8e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:48.487637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e0da8-ffdd-4b35-a7cc-385baba43e8e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:48.489401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 612/1230] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:48.495582 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:48.495991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:48.496145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:48.559555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:48.560774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:48.652789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 619/1231] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:48.685263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e0da8-ffdd-4b35-a7cc-385baba43e8e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:48.686836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-668e0da8-ffdd-4b35-a7cc-385baba43e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:48.811897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e0da8-ffdd-4b35-a7cc-385baba43e8e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:48.902096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d048ad-228a-4b89-bcec-24af9fd11bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:48.902986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d048ad-228a-4b89-bcec-24af9fd11bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:48.903269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d048ad-228a-4b89-bcec-24af9fd11bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:48.903543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d048ad-228a-4b89-bcec-24af9fd11bf4 admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:48.913279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d048ad-228a-4b89-bcec-24af9fd11bf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:48.915400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d048ad-228a-4b89-bcec-24af9fd11bf4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:48.917108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 613/1232] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:07:48 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:07:48.931288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:48.932599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:49.040995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98e1c-c4dc-4337-90bc-5b742c911116 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:49.113556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:49.114206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:49.114488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:49.114790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:49.116391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:49.222668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:49.224125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d3b6e-a869-4271-8dba-48e44e68083c service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:49.243882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 620/1233] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:51.988815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865241-5012-44a6-921d-64e5d1f192fe None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:51.989377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865241-5012-44a6-921d-64e5d1f192fe None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:51.989377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865241-5012-44a6-921d-64e5d1f192fe None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:51.991149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 614/1234] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:51.996808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5218d-7b99-445e-96d8-cdcf05087159 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:51.997220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5218d-7b99-445e-96d8-cdcf05087159 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:51.997404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5218d-7b99-445e-96d8-cdcf05087159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:52.061210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a9a5218d-7b99-445e-96d8-cdcf05087159 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:52.062392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a9a5218d-7b99-445e-96d8-cdcf05087159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:52.153578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 621/1235] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:52.190794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83865241-5012-44a6-921d-64e5d1f192fe None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:52.192298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-83865241-5012-44a6-921d-64e5d1f192fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:52.289603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83865241-5012-44a6-921d-64e5d1f192fe None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:52.361711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:52.362350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:52.362655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:52.362927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:52.364510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:52.466511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:52.468205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31cbde-0eab-4ba9-9ef9-d60e31da1e30 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:52.485821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 615/1236] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:54.654540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b169f4-d16c-4318-a2d3-900760a62222 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:54.655089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b169f4-d16c-4318-a2d3-900760a62222 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:54.655183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b169f4-d16c-4318-a2d3-900760a62222 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:54.656942 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 622/1237] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:07:54.662897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a361e-7922-40cb-a3fe-620a2db4edb9 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:54.663303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a361e-7922-40cb-a3fe-620a2db4edb9 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:54.663455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a361e-7922-40cb-a3fe-620a2db4edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:54.726216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-bf7a361e-7922-40cb-a3fe-620a2db4edb9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:54.727427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-bf7a361e-7922-40cb-a3fe-620a2db4edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:54.821158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 616/1238] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:54.862267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b169f4-d16c-4318-a2d3-900760a62222 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:54.863905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-02b169f4-d16c-4318-a2d3-900760a62222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:54.962057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b169f4-d16c-4318-a2d3-900760a62222 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:55.031070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:55.032245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:55.032523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:55.032796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:55.034382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:55.139775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:55.141722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9e4c8-5492-4484-a240-6265ee6f5406 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:55.159680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 623/1239] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:07:57.980332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6738a-efd7-4bcc-bce4-4dad9a92c963 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:57.980851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6738a-efd7-4bcc-bce4-4dad9a92c963 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:57.980953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6738a-efd7-4bcc-bce4-4dad9a92c963 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:57.982668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 617/1240] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:07:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:07:57.988528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d62dfd-a767-4293-9012-3e6edbdca1cf None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:57.988925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d62dfd-a767-4293-9012-3e6edbdca1cf None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:57.989087 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d62dfd-a767-4293-9012-3e6edbdca1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:58.055386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-24d62dfd-a767-4293-9012-3e6edbdca1cf None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:07:58.056566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-24d62dfd-a767-4293-9012-3e6edbdca1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:58.158368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:07:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:07:58.195893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6738a-efd7-4bcc-bce4-4dad9a92c963 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:07:58.198084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-00b6738a-efd7-4bcc-bce4-4dad9a92c963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:07:58.287377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6738a-efd7-4bcc-bce4-4dad9a92c963 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:07:58.290903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e922b9-9d62-4025-9dc6-b18196a83710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:07:58.291535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e922b9-9d62-4025-9dc6-b18196a83710 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:07:58.291815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e922b9-9d62-4025-9dc6-b18196a83710 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:07:58.292087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e922b9-9d62-4025-9dc6-b18196a83710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:07:58.301175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e922b9-9d62-4025-9dc6-b18196a83710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:07:58.302600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e922b9-9d62-4025-9dc6-b18196a83710 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:07:58.311550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 618/1242] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:07:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:02.696214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380a1f-a7bf-4a0d-a3e0-c09381e32041 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:02.696750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380a1f-a7bf-4a0d-a3e0-c09381e32041 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:02.696750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d380a1f-a7bf-4a0d-a3e0-c09381e32041 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:02.698605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 625/1243] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:02.705639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abede-142b-4c9f-b6b6-65667028e7de None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:02.706153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abede-142b-4c9f-b6b6-65667028e7de None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:02.706422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109abede-142b-4c9f-b6b6-65667028e7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:02.726120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-109abede-142b-4c9f-b6b6-65667028e7de None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:02.727426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-109abede-142b-4c9f-b6b6-65667028e7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:02.739069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 619/1244] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:02.778364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d380a1f-a7bf-4a0d-a3e0-c09381e32041 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:02.789867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d380a1f-a7bf-4a0d-a3e0-c09381e32041 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:02.793454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeae684-f641-4f84-84e7-37cddeded443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:02.794094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae684-f641-4f84-84e7-37cddeded443 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:02.794377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae684-f641-4f84-84e7-37cddeded443 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:02.794690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeae684-f641-4f84-84e7-37cddeded443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:02.803431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeae684-f641-4f84-84e7-37cddeded443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:02.804867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeae684-f641-4f84-84e7-37cddeded443 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:02.814277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 626/1245] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:05.965445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147998f-3c7a-45c3-b52d-f25424e518d6 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:05.966014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147998f-3c7a-45c3-b52d-f25424e518d6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:05.966014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147998f-3c7a-45c3-b52d-f25424e518d6 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:05.968363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 620/1246] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:05.974524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cf261-0a9f-4483-9f03-f5f1cd913be5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:05.974955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cf261-0a9f-4483-9f03-f5f1cd913be5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:05.975193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cf261-0a9f-4483-9f03-f5f1cd913be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:05.993401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-158cf261-0a9f-4483-9f03-f5f1cd913be5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:05.994600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-158cf261-0a9f-4483-9f03-f5f1cd913be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:06.002234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 627/1247] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:06.040449 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147998f-3c7a-45c3-b52d-f25424e518d6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:06.051309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147998f-3c7a-45c3-b52d-f25424e518d6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:06.054928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b7e30-2480-4e02-9ad8-a90bdaa54cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:06.055571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b7e30-2480-4e02-9ad8-a90bdaa54cef service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:06.055853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b7e30-2480-4e02-9ad8-a90bdaa54cef service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:06.056127 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b7e30-2480-4e02-9ad8-a90bdaa54cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:06.064969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b7e30-2480-4e02-9ad8-a90bdaa54cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:06.066402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b7e30-2480-4e02-9ad8-a90bdaa54cef service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:06.075756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 621/1248] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:10.595784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20d39-1f4c-455e-ba68-0636c6da6a1c None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:10.596287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20d39-1f4c-455e-ba68-0636c6da6a1c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:10.596287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb20d39-1f4c-455e-ba68-0636c6da6a1c None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:10.598083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 628/1249] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:10.603843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36456226-2543-4c7a-98fd-22776be08ac3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:10.604239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36456226-2543-4c7a-98fd-22776be08ac3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:10.604391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36456226-2543-4c7a-98fd-22776be08ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:10.621633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-36456226-2543-4c7a-98fd-22776be08ac3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:10.622838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-36456226-2543-4c7a-98fd-22776be08ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:10.630461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 622/1250] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:10.669480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20d39-1f4c-455e-ba68-0636c6da6a1c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:10.680622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb20d39-1f4c-455e-ba68-0636c6da6a1c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:10.684510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3d38b-4f63-4eb5-ac5e-b2d5dd929c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:10.685163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3d38b-4f63-4eb5-ac5e-b2d5dd929c0e service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:10.685454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3d38b-4f63-4eb5-ac5e-b2d5dd929c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:10.685733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3d38b-4f63-4eb5-ac5e-b2d5dd929c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:10.694957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3d38b-4f63-4eb5-ac5e-b2d5dd929c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:10.696389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3d38b-4f63-4eb5-ac5e-b2d5dd929c0e service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:10.706705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 629/1251] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:15.567211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41392e5-4e10-4f5c-a85f-0e0e535cae0f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:15.568666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41392e5-4e10-4f5c-a85f-0e0e535cae0f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:15.569160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41392e5-4e10-4f5c-a85f-0e0e535cae0f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:15.571777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 623/1252] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:08:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:15.587646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf784b3-5893-4433-848d-75265e1eef6e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:15.587646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf784b3-5893-4433-848d-75265e1eef6e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:15.587646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf784b3-5893-4433-848d-75265e1eef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:15.660413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ecf784b3-5893-4433-848d-75265e1eef6e None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:15.661675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ecf784b3-5893-4433-848d-75265e1eef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:15.780714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 630/1253] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:08:15 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:15.950612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a7feb-224a-4060-8115-25ade5d6ad36 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:15.951174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a7feb-224a-4060-8115-25ade5d6ad36 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:15.951686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a7feb-224a-4060-8115-25ade5d6ad36 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:15.954618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 624/1254] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:08:15 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:15.959962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b649-de43-404c-acd7-90602b77156f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:15.960510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b649-de43-404c-acd7-90602b77156f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:15.961002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355b649-de43-404c-acd7-90602b77156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:15.980835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d355b649-de43-404c-acd7-90602b77156f None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:15.982393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d355b649-de43-404c-acd7-90602b77156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:15.997073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 631/1255] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:08:15 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:20.237511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7617-c24e-4445-b84d-7f79369083c4 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:20.238048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7617-c24e-4445-b84d-7f79369083c4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:20.238048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d7617-c24e-4445-b84d-7f79369083c4 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:20.240972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 625/1256] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:08:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:20.245988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6897-2b30-47f4-9929-2bfa08c07e20 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:20.246953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6897-2b30-47f4-9929-2bfa08c07e20 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:20.247497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df6897-2b30-47f4-9929-2bfa08c07e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:20.268515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-25df6897-2b30-47f4-9929-2bfa08c07e20 None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:20.270782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-25df6897-2b30-47f4-9929-2bfa08c07e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:20.280392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 632/1257] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:08:20 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:21.731402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfc1f4-3d2b-415f-be33-c87a67ca7959 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:21.731916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfc1f4-3d2b-415f-be33-c87a67ca7959 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:21.731916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfc1f4-3d2b-415f-be33-c87a67ca7959 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:21.733633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 626/1258] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:08:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:21.739303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80778-8953-4c35-b0e2-dcd2e66df1dd None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:21.739734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80778-8953-4c35-b0e2-dcd2e66df1dd None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:21.739985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d80778-8953-4c35-b0e2-dcd2e66df1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:21.758957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-82d80778-8953-4c35-b0e2-dcd2e66df1dd None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:21.760163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-82d80778-8953-4c35-b0e2-dcd2e66df1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:21.768708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 633/1259] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:08:21 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:25.541011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46167eb-a0dc-415e-9e7a-01c412011864 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:25.541507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46167eb-a0dc-415e-9e7a-01c412011864 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:25.541605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46167eb-a0dc-415e-9e7a-01c412011864 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:25.543514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 627/1260] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:25.549961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249004f7-61fc-4f01-8edd-24614f1aaa5a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:25.550505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249004f7-61fc-4f01-8edd-24614f1aaa5a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:25.550625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249004f7-61fc-4f01-8edd-24614f1aaa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:25.570714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-249004f7-61fc-4f01-8edd-24614f1aaa5a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:25.572553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-249004f7-61fc-4f01-8edd-24614f1aaa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:25.581957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 634/1261] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:25.632145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57671ae-8faf-4e90-8ee2-1114ddad2f79 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:25.632599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57671ae-8faf-4e90-8ee2-1114ddad2f79 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:25.637332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57671ae-8faf-4e90-8ee2-1114ddad2f79 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:25.637332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 628/1262] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 10 05:08:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:25.641050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35ac1-169a-4852-8445-135f5164f7a2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:25.641346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35ac1-169a-4852-8445-135f5164f7a2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:25.641638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35ac1-169a-4852-8445-135f5164f7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:25.689741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-08f35ac1-169a-4852-8445-135f5164f7a2 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:25.691221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-08f35ac1-169a-4852-8445-135f5164f7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:25.770049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 635/1263] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 10 05:08:25 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:08:25.778035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57671ae-8faf-4e90-8ee2-1114ddad2f79 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:25.791932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57671ae-8faf-4e90-8ee2-1114ddad2f79 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:25.797427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c983d8-d571-4e6f-97fa-ebbb64387519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:25.798055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c983d8-d571-4e6f-97fa-ebbb64387519 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:25.798333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c983d8-d571-4e6f-97fa-ebbb64387519 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:25.798634 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c983d8-d571-4e6f-97fa-ebbb64387519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:25.806340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c983d8-d571-4e6f-97fa-ebbb64387519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:25.807951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c983d8-d571-4e6f-97fa-ebbb64387519 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:25.817465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 629/1264] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:28.177078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec126e1-5555-4f7a-9c3b-af2be3791a84 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:28.177597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec126e1-5555-4f7a-9c3b-af2be3791a84 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:28.177597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec126e1-5555-4f7a-9c3b-af2be3791a84 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:28.179459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 636/1265] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:08:28.186243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6fab4-00ac-4d4d-b97c-952acf898050 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:28.187696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6fab4-00ac-4d4d-b97c-952acf898050 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:28.187696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6fab4-00ac-4d4d-b97c-952acf898050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:28.207554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-59f6fab4-00ac-4d4d-b97c-952acf898050 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:28.209009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-59f6fab4-00ac-4d4d-b97c-952acf898050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:28.218250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 630/1266] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:28.265841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec126e1-5555-4f7a-9c3b-af2be3791a84 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:28.280322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec126e1-5555-4f7a-9c3b-af2be3791a84 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:28.285784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca081a67-5402-4969-b717-5ef4e24cd3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:28.286488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081a67-5402-4969-b717-5ef4e24cd3d2 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:28.286868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081a67-5402-4969-b717-5ef4e24cd3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:28.287208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081a67-5402-4969-b717-5ef4e24cd3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:28.295428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca081a67-5402-4969-b717-5ef4e24cd3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:28.298279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca081a67-5402-4969-b717-5ef4e24cd3d2 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:28.309008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 637/1267] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:30.938111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97305a6c-254e-4fb3-88ea-ee6461895979 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:30.938665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97305a6c-254e-4fb3-88ea-ee6461895979 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:30.938665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97305a6c-254e-4fb3-88ea-ee6461895979 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:30.940351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 631/1268] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:30.946208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd25a1-b763-4376-96b5-e79af3d20519 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:30.946647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd25a1-b763-4376-96b5-e79af3d20519 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:30.946822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd25a1-b763-4376-96b5-e79af3d20519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:30.966057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d9fd25a1-b763-4376-96b5-e79af3d20519 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:30.967267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d9fd25a1-b763-4376-96b5-e79af3d20519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:30.975379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 638/1269] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:31.022606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4cc7-229a-4ffa-8f7b-57c60fc01c39 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:31.022988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4cc7-229a-4ffa-8f7b-57c60fc01c39 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:31.023262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb4cc7-229a-4ffa-8f7b-57c60fc01c39 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:31.025035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 632/1270] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 10 05:08:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:31.030786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e74cb1-ec85-476b-a2b2-183440da1b42 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:31.031082 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e74cb1-ec85-476b-a2b2-183440da1b42 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:31.031363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e74cb1-ec85-476b-a2b2-183440da1b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:31.049752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-78e74cb1-ec85-476b-a2b2-183440da1b42 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:31.050981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-78e74cb1-ec85-476b-a2b2-183440da1b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:31.060310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 639/1271] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 10 05:08:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:31.068885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb4cc7-229a-4ffa-8f7b-57c60fc01c39 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:31.083575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badb4cc7-229a-4ffa-8f7b-57c60fc01c39 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:31.088944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d345a-b276-4566-bb91-0b2ec36fb2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:31.089584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d345a-b276-4566-bb91-0b2ec36fb2b3 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:31.089860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d345a-b276-4566-bb91-0b2ec36fb2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:31.090132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d345a-b276-4566-bb91-0b2ec36fb2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:31.101122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d345a-b276-4566-bb91-0b2ec36fb2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:31.102747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d345a-b276-4566-bb91-0b2ec36fb2b3 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:31.113662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 633/1272] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:33.388692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91cdf-87f7-48e1-b61f-7ade49da16a4 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.389210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91cdf-87f7-48e1-b61f-7ade49da16a4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.389210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e91cdf-87f7-48e1-b61f-7ade49da16a4 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.391741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 640/1273] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:33.397631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b013-fc0f-412e-9f9a-0a35250ad576 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.398374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b013-fc0f-412e-9f9a-0a35250ad576 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.398859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b013-fc0f-412e-9f9a-0a35250ad576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.416572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e4e0b013-fc0f-412e-9f9a-0a35250ad576 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:33.417979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e4e0b013-fc0f-412e-9f9a-0a35250ad576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:33.426496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 634/1274] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:33.484848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e1c8-27de-403e-a1ac-caeaae857ec0 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.485399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e1c8-27de-403e-a1ac-caeaae857ec0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.485770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66e1c8-27de-403e-a1ac-caeaae857ec0 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.487825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 641/1275] 10.222.0.16 () {54 vars in 966 bytes} [Tue Aug 10 05:08:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:33.493221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.493717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.494016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.523041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9401dc-e3d7-4c23-9ff9-eb10a9073d44 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.523326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9401dc-e3d7-4c23-9ff9-eb10a9073d44 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.523899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9401dc-e3d7-4c23-9ff9-eb10a9073d44 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.526446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 642/1276] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:33.535136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.535422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.535859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.557742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:33.559579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:33.560858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] MFA Rules not processed for user `c0521977aa404994bcb8e6ce0dea4bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:33.563142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:33.569067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 643/1277] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:08:33.617393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:33.630297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 635/1278] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 10 05:08:33 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:33.632074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac31a1-6987-4e3f-873d-4bae655f9f85 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:33.638067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:33.638212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e5803-6725-4992-8970-ef21ceb97a01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:33.638784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5803-6725-4992-8970-ef21ceb97a01 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.639072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5803-6725-4992-8970-ef21ceb97a01 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.639351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e5803-6725-4992-8970-ef21ceb97a01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.645276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a51b27-9262-4841-8d6e-32577285f1cc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:33.647961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5803-6725-4992-8970-ef21ceb97a01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:33.649118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bdd3bc-f5c9-4bdf-ba80-bcd35cc69d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:33.649719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e5803-6725-4992-8970-ef21ceb97a01 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:33.649828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd3bc-f5c9-4bdf-ba80-bcd35cc69d99 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:33.650014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd3bc-f5c9-4bdf-ba80-bcd35cc69d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:33.650270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bdd3bc-f5c9-4bdf-ba80-bcd35cc69d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:33.659224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdd3bc-f5c9-4bdf-ba80-bcd35cc69d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:33.659721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 644/1279] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:33.660641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bdd3bc-f5c9-4bdf-ba80-bcd35cc69d99 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:33.670361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 636/1280] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:08:35.991295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4eae-0759-4d82-95d6-20edf86d6ab5 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:35.991802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4eae-0759-4d82-95d6-20edf86d6ab5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:35.991802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff4eae-0759-4d82-95d6-20edf86d6ab5 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:35.993533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 645/1281] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:36.000005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91554353-48ae-428e-aa4d-2065f5c7b26c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:36.000429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91554353-48ae-428e-aa4d-2065f5c7b26c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:36.000583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91554353-48ae-428e-aa4d-2065f5c7b26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:36.018253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-91554353-48ae-428e-aa4d-2065f5c7b26c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:36.019495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-91554353-48ae-428e-aa4d-2065f5c7b26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:36.027489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 637/1282] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:36.073139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff4eae-0759-4d82-95d6-20edf86d6ab5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:36.087122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff4eae-0759-4d82-95d6-20edf86d6ab5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:36.092443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843ac34-47f5-4ba8-949e-c4385b6728c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:36.093840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ac34-47f5-4ba8-949e-c4385b6728c2 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:36.094124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ac34-47f5-4ba8-949e-c4385b6728c2 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:36.094402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843ac34-47f5-4ba8-949e-c4385b6728c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:36.102208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ac34-47f5-4ba8-949e-c4385b6728c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:36.103829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8843ac34-47f5-4ba8-949e-c4385b6728c2 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:36.113502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 646/1283] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:38.345201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0843-f9c8-49f7-b3b2-ab3a94980bb9 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:38.346156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0843-f9c8-49f7-b3b2-ab3a94980bb9 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:38.346446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d0843-f9c8-49f7-b3b2-ab3a94980bb9 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:38.348231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 638/1284] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:38.354186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999686a-7c32-49e9-88e7-887b900d052a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:38.354632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999686a-7c32-49e9-88e7-887b900d052a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:38.354776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999686a-7c32-49e9-88e7-887b900d052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:38.373869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e999686a-7c32-49e9-88e7-887b900d052a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:38.375359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e999686a-7c32-49e9-88e7-887b900d052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:38.383374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 647/1285] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:38.430238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0843-f9c8-49f7-b3b2-ab3a94980bb9 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:38.445980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d0843-f9c8-49f7-b3b2-ab3a94980bb9 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:38.451989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3fb30-9789-4fae-a3a1-4b4b82563d83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:38.452852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3fb30-9789-4fae-a3a1-4b4b82563d83 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:38.453328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3fb30-9789-4fae-a3a1-4b4b82563d83 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:38.453759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3fb30-9789-4fae-a3a1-4b4b82563d83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:38.463847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3fb30-9789-4fae-a3a1-4b4b82563d83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:38.466569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3fb30-9789-4fae-a3a1-4b4b82563d83 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:38.478742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 639/1286] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:40.777069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f561-95a5-4616-9d0e-b0052abfdb11 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:40.777535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f561-95a5-4616-9d0e-b0052abfdb11 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:40.777720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046f561-95a5-4616-9d0e-b0052abfdb11 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:40.780893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 648/1287] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:40.786948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d7801-3b39-4459-9bfd-3b004b7da28d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:40.787371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d7801-3b39-4459-9bfd-3b004b7da28d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:40.787515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d7801-3b39-4459-9bfd-3b004b7da28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:40.806764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d30d7801-3b39-4459-9bfd-3b004b7da28d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:40.807961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d30d7801-3b39-4459-9bfd-3b004b7da28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:40.815879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 640/1288] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:40.859427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f561-95a5-4616-9d0e-b0052abfdb11 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:40.873856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046f561-95a5-4616-9d0e-b0052abfdb11 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:40.880048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0c3fb-acf2-405b-ab32-0ae5d8e30a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:40.880769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c3fb-acf2-405b-ab32-0ae5d8e30a5f service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:40.881131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c3fb-acf2-405b-ab32-0ae5d8e30a5f service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:40.881492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c3fb-acf2-405b-ab32-0ae5d8e30a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:40.890373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0c3fb-acf2-405b-ab32-0ae5d8e30a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:40.892016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0c3fb-acf2-405b-ab32-0ae5d8e30a5f service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:40.901555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 649/1289] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:43.089518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c54b5-28c5-4284-8838-4c4dd36ee280 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:43.090173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c54b5-28c5-4284-8838-4c4dd36ee280 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:43.090173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c54b5-28c5-4284-8838-4c4dd36ee280 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:43.091869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 641/1290] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:43.098240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6543692-dd78-4bbc-96e7-d415822d6aae None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:43.098746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6543692-dd78-4bbc-96e7-d415822d6aae None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:43.098852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6543692-dd78-4bbc-96e7-d415822d6aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:43.116765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c6543692-dd78-4bbc-96e7-d415822d6aae None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:43.117958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c6543692-dd78-4bbc-96e7-d415822d6aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:43.126217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 650/1291] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:08:43.172677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c54b5-28c5-4284-8838-4c4dd36ee280 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:43.190437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c54b5-28c5-4284-8838-4c4dd36ee280 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:43.197135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66a799-0c53-4ce3-8386-ed9114ca5ad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:43.198001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a799-0c53-4ce3-8386-ed9114ca5ad5 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:43.198349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a799-0c53-4ce3-8386-ed9114ca5ad5 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:43.198747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66a799-0c53-4ce3-8386-ed9114ca5ad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:43.210386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66a799-0c53-4ce3-8386-ed9114ca5ad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:43.212745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66a799-0c53-4ce3-8386-ed9114ca5ad5 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:43.226854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 642/1292] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:45.547101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e160-e085-49d8-b3cf-7b5d4820490d None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:45.547622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e160-e085-49d8-b3cf-7b5d4820490d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:45.547622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9e160-e085-49d8-b3cf-7b5d4820490d None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:45.549411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 651/1293] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:45.555735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f27a-59cf-4b2a-9d8b-7ade062a0fe3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:45.556155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f27a-59cf-4b2a-9d8b-7ade062a0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:45.556294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e503f27a-59cf-4b2a-9d8b-7ade062a0fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:45.574741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e503f27a-59cf-4b2a-9d8b-7ade062a0fe3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:45.575933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e503f27a-59cf-4b2a-9d8b-7ade062a0fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:45.584246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 643/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:45.630942 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e160-e085-49d8-b3cf-7b5d4820490d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:45.646287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9e160-e085-49d8-b3cf-7b5d4820490d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:45.652105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e885bb-bbc1-4d99-b12e-abbf04503845 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:45.652851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e885bb-bbc1-4d99-b12e-abbf04503845 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:45.653152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e885bb-bbc1-4d99-b12e-abbf04503845 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:45.653443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e885bb-bbc1-4d99-b12e-abbf04503845 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:45.662540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e885bb-bbc1-4d99-b12e-abbf04503845 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:45.664201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e885bb-bbc1-4d99-b12e-abbf04503845 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:45.673864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 652/1295] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:47.939932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe327-7aec-463a-a77e-fdcc0ea30d5c None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:47.940487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe327-7aec-463a-a77e-fdcc0ea30d5c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:47.940487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfe327-7aec-463a-a77e-fdcc0ea30d5c None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:47.942233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 644/1296] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:47.948011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f2d94-035a-4649-9f68-71444feabf9e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:47.948451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f2d94-035a-4649-9f68-71444feabf9e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:47.948573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9f2d94-035a-4649-9f68-71444feabf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:47.966687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1a9f2d94-035a-4649-9f68-71444feabf9e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:47.968548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1a9f2d94-035a-4649-9f68-71444feabf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:47.976263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 653/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:48.021328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfe327-7aec-463a-a77e-fdcc0ea30d5c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:48.036105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfe327-7aec-463a-a77e-fdcc0ea30d5c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:48.041513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617204d0-26c9-43f4-a7f0-0064c7429ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:48.042151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617204d0-26c9-43f4-a7f0-0064c7429ed5 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:48.042434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617204d0-26c9-43f4-a7f0-0064c7429ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:48.042740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617204d0-26c9-43f4-a7f0-0064c7429ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:48.050819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617204d0-26c9-43f4-a7f0-0064c7429ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:48.052404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617204d0-26c9-43f4-a7f0-0064c7429ed5 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:48.062255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 645/1298] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:48.512260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c083-c4da-43ed-8dcb-1a3cd355c304 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:48.512547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c083-c4da-43ed-8dcb-1a3cd355c304 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:48.512825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257c083-c4da-43ed-8dcb-1a3cd355c304 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:48.514629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 654/1299] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:48.520785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353edb1-2701-4160-a594-4bc308e273f3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:48.521077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353edb1-2701-4160-a594-4bc308e273f3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:48.521354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353edb1-2701-4160-a594-4bc308e273f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:48.539355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0353edb1-2701-4160-a594-4bc308e273f3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:48.540545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0353edb1-2701-4160-a594-4bc308e273f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:48.548778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 646/1300] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:48.604504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6169d-5f47-48b6-b533-69264307d363 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:48.604809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6169d-5f47-48b6-b533-69264307d363 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:48.605074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6169d-5f47-48b6-b533-69264307d363 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:48.607045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 655/1301] 10.222.0.16 () {54 vars in 966 bytes} [Tue Aug 10 05:08:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:48.612904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c068941-3b73-4483-ad7b-93435695c71d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:48.613197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c068941-3b73-4483-ad7b-93435695c71d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:48.613478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c068941-3b73-4483-ad7b-93435695c71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:48.660805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8c068941-3b73-4483-ad7b-93435695c71d None None] MFA Rules not processed for user `5350c5f195db471189281bf10b9cd9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:48.661978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8c068941-3b73-4483-ad7b-93435695c71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:48.718913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 647/1302] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 10 05:08:48 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:48.726868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6169d-5f47-48b6-b533-69264307d363 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:48.737957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6169d-5f47-48b6-b533-69264307d363 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:48.741475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb0e4c-fefe-4df9-bde3-afc463ca2e4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:48.742507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0e4c-fefe-4df9-bde3-afc463ca2e4f service glance] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:48.742823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0e4c-fefe-4df9-bde3-afc463ca2e4f service glance] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:48.743100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb0e4c-fefe-4df9-bde3-afc463ca2e4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:48.752376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0e4c-fefe-4df9-bde3-afc463ca2e4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:48.753812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb0e4c-fefe-4df9-bde3-afc463ca2e4f service glance] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:48.762968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 656/1303] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:49.315046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461b155-8b22-40b1-b614-b2a8bd86e3d1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:49.315523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461b155-8b22-40b1-b614-b2a8bd86e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:49.315712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461b155-8b22-40b1-b614-b2a8bd86e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:49.366593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d461b155-8b22-40b1-b614-b2a8bd86e3d1 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:49.367795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d461b155-8b22-40b1-b614-b2a8bd86e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:49.431264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 648/1304] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:08:49 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:49.473948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30916e-7171-40d3-82c2-209cf2a64bb0 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:49.474398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30916e-7171-40d3-82c2-209cf2a64bb0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:49.474512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30916e-7171-40d3-82c2-209cf2a64bb0 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:49.476331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 657/1305] 10.222.0.16 () {54 vars in 942 bytes} [Tue Aug 10 05:08:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:49.482760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51bbe-155e-4640-b4ff-4dbb6d9e81ad None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:49.483052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51bbe-155e-4640-b4ff-4dbb6d9e81ad None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:49.483881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af51bbe-155e-4640-b4ff-4dbb6d9e81ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:49.531434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0af51bbe-155e-4640-b4ff-4dbb6d9e81ad None None] MFA Rules not processed for user `92f6a41de2f0409db2d99a8c3ee5b4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:49.532699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0af51bbe-155e-4640-b4ff-4dbb6d9e81ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:49.603159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 649/1306] 10.222.0.16 () {58 vars in 1040 bytes} [Tue Aug 10 05:08:49 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:49.613397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30916e-7171-40d3-82c2-209cf2a64bb0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:49.626824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30916e-7171-40d3-82c2-209cf2a64bb0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:49.631672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca6d31-5712-4095-9652-5d463da494f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:49.632309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca6d31-5712-4095-9652-5d463da494f3 service swift] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:49.632592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca6d31-5712-4095-9652-5d463da494f3 service swift] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:49.632866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca6d31-5712-4095-9652-5d463da494f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:49.641076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca6d31-5712-4095-9652-5d463da494f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:49.642689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca6d31-5712-4095-9652-5d463da494f3 service swift] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:49.650482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 658/1307] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:08:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:08:50.314416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399da5a-495f-485a-807e-f9193f7f692e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:50.314749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399da5a-495f-485a-807e-f9193f7f692e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:50.315046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9399da5a-495f-485a-807e-f9193f7f692e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:50.317101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 650/1308] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:50.322835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0aa13-0ff8-4a27-b7bf-345f73e98eda None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:50.323380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0aa13-0ff8-4a27-b7bf-345f73e98eda None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:50.326898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0aa13-0ff8-4a27-b7bf-345f73e98eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:50.342206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-01c0aa13-0ff8-4a27-b7bf-345f73e98eda None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:50.344398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-01c0aa13-0ff8-4a27-b7bf-345f73e98eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:50.352710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 659/1309] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:50.398804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399da5a-495f-485a-807e-f9193f7f692e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:50.415462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9399da5a-495f-485a-807e-f9193f7f692e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:50.421949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b810c5-c989-4e18-ab1d-224258cd8c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:50.422734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b810c5-c989-4e18-ab1d-224258cd8c4b service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:50.423049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b810c5-c989-4e18-ab1d-224258cd8c4b service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:50.423321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b810c5-c989-4e18-ab1d-224258cd8c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:50.431984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b810c5-c989-4e18-ab1d-224258cd8c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:50.433602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b810c5-c989-4e18-ab1d-224258cd8c4b service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:50.444440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 651/1310] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:08:52.736271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f54f-8104-4fc2-8be7-c6b65e3249e8 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:52.736786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f54f-8104-4fc2-8be7-c6b65e3249e8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:52.736890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f54f-8104-4fc2-8be7-c6b65e3249e8 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:52.738921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 660/1311] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:08:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:08:52.745227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9adc33-0697-447f-ba0f-450b9f8ee5f6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:52.745720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9adc33-0697-447f-ba0f-450b9f8ee5f6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:52.745824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9adc33-0697-447f-ba0f-450b9f8ee5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:52.764141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7d9adc33-0697-447f-ba0f-450b9f8ee5f6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:08:52.765893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7d9adc33-0697-447f-ba0f-450b9f8ee5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:08:52.777037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 652/1312] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:08:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:08:52.822017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f54f-8104-4fc2-8be7-c6b65e3249e8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:08:52.837195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f54f-8104-4fc2-8be7-c6b65e3249e8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:08:52.844954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8dce1-2ba7-41c9-8021-ed78f00ccb92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:08:52.845607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8dce1-2ba7-41c9-8021-ed78f00ccb92 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:08:52.845889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8dce1-2ba7-41c9-8021-ed78f00ccb92 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:08:52.846168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8dce1-2ba7-41c9-8021-ed78f00ccb92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:08:52.854633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8dce1-2ba7-41c9-8021-ed78f00ccb92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:08:52.856317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8dce1-2ba7-41c9-8021-ed78f00ccb92 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:08:52.866559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 661/1313] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:08:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:08.109231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342c23-08b6-4ef0-8f59-4859ae0c6b92 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:08.109813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342c23-08b6-4ef0-8f59-4859ae0c6b92 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:08.109813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342c23-08b6-4ef0-8f59-4859ae0c6b92 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:08.111561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 653/1314] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:08.117302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2fc2-8d64-4866-b092-23e7c20f06bd None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:08.117695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2fc2-8d64-4866-b092-23e7c20f06bd None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:08.117855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a2fc2-8d64-4866-b092-23e7c20f06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:08.135043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-730a2fc2-8d64-4866-b092-23e7c20f06bd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:08.136218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-730a2fc2-8d64-4866-b092-23e7c20f06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:08.143816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 662/1315] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:08.167963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec342c23-08b6-4ef0-8f59-4859ae0c6b92 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:08.180539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec342c23-08b6-4ef0-8f59-4859ae0c6b92 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:08.184877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c7d01-548a-417b-92fd-8062bbc0b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:08.185512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c7d01-548a-417b-92fd-8062bbc0b173 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:08.185796 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c7d01-548a-417b-92fd-8062bbc0b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:08.186064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c7d01-548a-417b-92fd-8062bbc0b173 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:08.187347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c7d01-548a-417b-92fd-8062bbc0b173 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:08.189183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c7d01-548a-417b-92fd-8062bbc0b173 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:08.207667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 654/1316] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 05:09:08 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:09:10.252435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf25cae-3a48-474c-87df-5b608b39b672 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:10.252994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf25cae-3a48-474c-87df-5b608b39b672 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:10.252994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf25cae-3a48-474c-87df-5b608b39b672 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:10.254765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 663/1317] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:10.260468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:10.260878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:10.261031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:10.278398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:10.279600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:10.287736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 655/1318] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:10.312351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf25cae-3a48-474c-87df-5b608b39b672 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:10.324689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf25cae-3a48-474c-87df-5b608b39b672 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:10.329238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:10.330083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:10.330368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:10.330676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] PATH_INFO: `/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:10.341070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] RBAC: Authorizing `identity:get_project(project_id=0498e0a8099f45c7870d1f5f8ad93fd1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:10.344014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:10.345692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 664/1319] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:10 2021] GET /identity/v3/projects/0498e0a8099f45c7870d1f5f8ad93fd1 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:10.352085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:10.361674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85c58c-24ce-4941-8871-dfb683243497 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:10.366145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:10.366805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:10.367086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:10.367358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:10.368120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] RBAC: Adding query filter params (scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:10.368423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:10.370255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:10.377678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 656/1320] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:10 2021] GET /identity/v3/role_assignments?scope.project.id=0498e0a8099f45c7870d1f5f8ad93fd1 => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:09:10.383827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:10.393402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ede0e-a067-42a3-89a8-3334d9e996bb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:10.397899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e40076-0fab-4bbc-bda8-edf6d77f2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:10.398780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e40076-0fab-4bbc-bda8-edf6d77f2be9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:10.399066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e40076-0fab-4bbc-bda8-edf6d77f2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:10.399347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e40076-0fab-4bbc-bda8-edf6d77f2be9 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:10.400510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e40076-0fab-4bbc-bda8-edf6d77f2be9 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:10.402295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e40076-0fab-4bbc-bda8-edf6d77f2be9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:10.403894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 665/1321] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:10 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:10.410261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:10.419746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c22f32-d8ee-4436-a534-39ee5a49ce36 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:10.424787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daa5cd-bd3f-486e-b98c-5f8da5b9d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:10.425628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa5cd-bd3f-486e-b98c-5f8da5b9d457 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:10.425912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa5cd-bd3f-486e-b98c-5f8da5b9d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:10.426187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daa5cd-bd3f-486e-b98c-5f8da5b9d457 admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:10.439171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daa5cd-bd3f-486e-b98c-5f8da5b9d457 admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:10.441290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daa5cd-bd3f-486e-b98c-5f8da5b9d457 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:10.442915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 657/1322] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:10 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:09:12.598310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638600c7-6d4e-4e74-ab89-2916767f6497 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:12.598907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638600c7-6d4e-4e74-ab89-2916767f6497 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:12.598907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638600c7-6d4e-4e74-ab89-2916767f6497 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:12.600655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 666/1323] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:12.606356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:12.606821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:12.607011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:12.624972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:12.626156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:12.633878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 658/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:12.657649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638600c7-6d4e-4e74-ab89-2916767f6497 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:12.672012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638600c7-6d4e-4e74-ab89-2916767f6497 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:12.676473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:12.677322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:12.677606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:12.677887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] PATH_INFO: `/v3/projects/302284a16ed54a56a67750fe4d350fba` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:12.689962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] RBAC: Authorizing `identity:get_project(project_id=302284a16ed54a56a67750fe4d350fba)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:12.692071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:12.693859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 667/1325] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:12 2021] GET /identity/v3/projects/302284a16ed54a56a67750fe4d350fba => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:12.700550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:12.710051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbabdc2-0d43-4d89-9e92-a2c5f902f23c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:12.714601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:12.715254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:12.715534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:12.715803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:12.716562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] RBAC: Adding query filter params (scope.project.id=302284a16ed54a56a67750fe4d350fba) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:12.716864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:12.719106 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211905e8-1883-40a6-94df-7f0659bf300b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:12.724255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 659/1326] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:12 2021] GET /identity/v3/role_assignments?scope.project.id=302284a16ed54a56a67750fe4d350fba => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:12.730033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:12.739575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8699f69-2ec0-4811-9143-ef8906c52f0a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:12.744079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1679b84-9cda-4082-bb08-0703765d8f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:12.744923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1679b84-9cda-4082-bb08-0703765d8f8d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:12.745228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1679b84-9cda-4082-bb08-0703765d8f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:12.745503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1679b84-9cda-4082-bb08-0703765d8f8d admin admin] PATH_INFO: `/v3/users/f099659e0c6745fd8be02a3dac109bc2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:12.746692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1679b84-9cda-4082-bb08-0703765d8f8d admin admin] RBAC: Authorizing `identity:get_user(user_id=f099659e0c6745fd8be02a3dac109bc2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:12.749338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1679b84-9cda-4082-bb08-0703765d8f8d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:12.750922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 668/1327] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:12 2021] GET /identity/v3/users/f099659e0c6745fd8be02a3dac109bc2 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:14.842154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5c1b-df96-475e-bc64-915599265146 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:14.842682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5c1b-df96-475e-bc64-915599265146 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:14.842682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af5c1b-df96-475e-bc64-915599265146 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:14.844688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 660/1328] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:14.850352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:14.850756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:14.850962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:14.868636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:14.869814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:14.877866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 669/1329] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:14.901688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af5c1b-df96-475e-bc64-915599265146 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:14.913599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af5c1b-df96-475e-bc64-915599265146 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:14.918004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:14.918868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:14.919150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:14.919421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] PATH_INFO: `/v3/projects/4b85582f80fd41e99891f479d3dc661d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:14.930175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] RBAC: Authorizing `identity:get_project(project_id=4b85582f80fd41e99891f479d3dc661d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:14.932375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:14.934053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 661/1330] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:14 2021] GET /identity/v3/projects/4b85582f80fd41e99891f479d3dc661d => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:14.940913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:14.949811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6513a-e889-471a-9770-2fd5b289f610 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:14.954941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:14.955575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:14.955858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:14.956135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:14.956889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] RBAC: Adding query filter params (scope.project.id=4b85582f80fd41e99891f479d3dc661d) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:14.957200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:14.959075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:14.965609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 670/1331] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:14 2021] GET /identity/v3/role_assignments?scope.project.id=4b85582f80fd41e99891f479d3dc661d => generated 877 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:14.971963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:14.981328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24801915-5320-49fc-aa1c-3b8d5e64f8a9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:14.985785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee6ed5-399b-4384-ace4-a559a998a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:14.986650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6ed5-399b-4384-ace4-a559a998a52b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:14.986934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6ed5-399b-4384-ace4-a559a998a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:14.987207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee6ed5-399b-4384-ace4-a559a998a52b admin admin] PATH_INFO: `/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:15.000525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee6ed5-399b-4384-ace4-a559a998a52b admin admin] RBAC: Authorizing `identity:get_user(user_id=53c67278ecfa4e62b8abd2f13a8fef9a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:15.002683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee6ed5-399b-4384-ace4-a559a998a52b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:15.004288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 662/1332] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:14 2021] GET /identity/v3/users/53c67278ecfa4e62b8abd2f13a8fef9a => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:15.010518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:15.021028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffad37d-28b6-497d-aace-51dab3557e71 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:15.025568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2203e3-1396-474d-a663-15d2933f1eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:15.026426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2203e3-1396-474d-a663-15d2933f1eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:15.026741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2203e3-1396-474d-a663-15d2933f1eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:15.027019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2203e3-1396-474d-a663-15d2933f1eb1 admin admin] PATH_INFO: `/v3/users/999ec943721447cc8f302a8bacce83ee` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:15.040069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2203e3-1396-474d-a663-15d2933f1eb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=999ec943721447cc8f302a8bacce83ee)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:15.042211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2203e3-1396-474d-a663-15d2933f1eb1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:15.043893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 671/1333] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:15 2021] GET /identity/v3/users/999ec943721447cc8f302a8bacce83ee => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:17.207423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb39f3-84a1-422d-b5ab-43019a6c705f None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:17.207961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb39f3-84a1-422d-b5ab-43019a6c705f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:17.207961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb39f3-84a1-422d-b5ab-43019a6c705f None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:17.209733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 663/1334] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:17.215480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:17.215939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:17.216047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:17.234854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:17.236048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:17.243914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 672/1335] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:17.267939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb39f3-84a1-422d-b5ab-43019a6c705f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:17.280783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb39f3-84a1-422d-b5ab-43019a6c705f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:17.285284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:17.286244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:17.286528 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:17.286957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] PATH_INFO: `/v3/projects/79885c02a227401887073ba7ae7f4ff7` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:17.297375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] RBAC: Authorizing `identity:get_project(project_id=79885c02a227401887073ba7ae7f4ff7)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:17.299482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:17.301215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 664/1336] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:17 2021] GET /identity/v3/projects/79885c02a227401887073ba7ae7f4ff7 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:17.307876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:17.317006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e89dc-57ca-4258-97af-69957ec0fadb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:17.321631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:17.322284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:17.322563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:17.322867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:17.323731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] RBAC: Adding query filter params (scope.project.id=79885c02a227401887073ba7ae7f4ff7) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:17.324033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:17.325877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050593c0-ec74-4e40-92ad-278f2de45d70 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:17.331910 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 673/1337] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:17 2021] GET /identity/v3/role_assignments?scope.project.id=79885c02a227401887073ba7ae7f4ff7 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:17.338193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:17.348919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f718165-0cd6-4185-905a-9f758725f951 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:17.353639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113e82-9818-436a-94b3-5a6b0c7f01c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:17.354494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113e82-9818-436a-94b3-5a6b0c7f01c5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:17.354820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113e82-9818-436a-94b3-5a6b0c7f01c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:17.355086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113e82-9818-436a-94b3-5a6b0c7f01c5 admin admin] PATH_INFO: `/v3/users/322c9f712ca04a63bb11e511e734fd4a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:17.369924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33113e82-9818-436a-94b3-5a6b0c7f01c5 admin admin] RBAC: Authorizing `identity:get_user(user_id=322c9f712ca04a63bb11e511e734fd4a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:17.372342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33113e82-9818-436a-94b3-5a6b0c7f01c5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:17.374063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 665/1338] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:17 2021] GET /identity/v3/users/322c9f712ca04a63bb11e511e734fd4a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:19.487919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b4f7-655c-417b-bd71-5e27b6167da6 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:19.488465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b4f7-655c-417b-bd71-5e27b6167da6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:19.488465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b4f7-655c-417b-bd71-5e27b6167da6 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:19.490222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 674/1339] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:09:19.495945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:19.496330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:19.496496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:19.514827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:19.516000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:19.523724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 666/1340] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:19.548064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b4f7-655c-417b-bd71-5e27b6167da6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:19.560557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b4f7-655c-417b-bd71-5e27b6167da6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:19.565609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:19.566476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:19.566781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:19.567053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] PATH_INFO: `/v3/projects/8beb590f33a341adaea78fed778aaecf` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:19.568206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] RBAC: Authorizing `identity:get_project(project_id=8beb590f33a341adaea78fed778aaecf)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:19.570022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:19.571694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 675/1341] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:19 2021] GET /identity/v3/projects/8beb590f33a341adaea78fed778aaecf => generated 344 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:19.578092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:19.587115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac54bf0-aca5-4652-8a1c-2eba15ba9c1b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:19.591707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:19.592346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:19.592630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:19.592911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:19.593676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] RBAC: Adding query filter params (scope.project.id=8beb590f33a341adaea78fed778aaecf) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:19.594238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:19.596167 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c243b-1af8-4e5c-a396-9ff14ddf4918 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:19.601802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 667/1342] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:19 2021] GET /identity/v3/role_assignments?scope.project.id=8beb590f33a341adaea78fed778aaecf => generated 879 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:19.608278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:19.617559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80840a-e8ac-4c20-a0b5-3a2aae02593f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:19.621977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248db331-a6d6-4aa0-9e50-83cdf3b3383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:19.622839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db331-a6d6-4aa0-9e50-83cdf3b3383c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:19.623121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db331-a6d6-4aa0-9e50-83cdf3b3383c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:19.623389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248db331-a6d6-4aa0-9e50-83cdf3b3383c admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:19.625070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248db331-a6d6-4aa0-9e50-83cdf3b3383c admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:19.626850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248db331-a6d6-4aa0-9e50-83cdf3b3383c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:19.628380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 676/1343] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:19 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:21.747808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84076-b447-4a48-bcb3-f94a42666528 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:21.748451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84076-b447-4a48-bcb3-f94a42666528 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:21.748451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a84076-b447-4a48-bcb3-f94a42666528 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:21.750240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 668/1344] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:21.756596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:21.757044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:21.757178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:21.775334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:21.776514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:21.785017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 677/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:21.815001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84076-b447-4a48-bcb3-f94a42666528 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:21.827766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a84076-b447-4a48-bcb3-f94a42666528 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:21.832255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:21.833100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:21.833382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:21.833657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] PATH_INFO: `/v3/projects/9f6e917853f1431a905c5e4d0acd3de4` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:21.844967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] RBAC: Authorizing `identity:get_project(project_id=9f6e917853f1431a905c5e4d0acd3de4)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:21.847088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:21.848751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 669/1346] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:21 2021] GET /identity/v3/projects/9f6e917853f1431a905c5e4d0acd3de4 => generated 361 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:21.855225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:21.864253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28c005a-35dd-4fc9-9308-090edb3c5de0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:21.868861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:21.869497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:21.869781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:21.870059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:21.870873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] RBAC: Adding query filter params (scope.project.id=9f6e917853f1431a905c5e4d0acd3de4) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:21.871180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:21.873041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f0428-2041-4d0a-ae8a-8126bbe8e6b8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:21.878302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 678/1347] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:21 2021] GET /identity/v3/role_assignments?scope.project.id=9f6e917853f1431a905c5e4d0acd3de4 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:21.884462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:21.894457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2680a-06dd-46a2-a180-c8a511a65d16 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:21.898961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd6363-4bb0-4b2b-88ff-cd482654d564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:21.900673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6363-4bb0-4b2b-88ff-cd482654d564 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:21.900673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6363-4bb0-4b2b-88ff-cd482654d564 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:21.900673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd6363-4bb0-4b2b-88ff-cd482654d564 admin admin] PATH_INFO: `/v3/users/599648bf33094450b64fa0ab0f945e19` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:21.914566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6363-4bb0-4b2b-88ff-cd482654d564 admin admin] RBAC: Authorizing `identity:get_user(user_id=599648bf33094450b64fa0ab0f945e19)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:21.916759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd6363-4bb0-4b2b-88ff-cd482654d564 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:21.918410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 670/1348] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:21 2021] GET /identity/v3/users/599648bf33094450b64fa0ab0f945e19 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:09:24.054411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c2561-0632-4dd8-8c94-d845ba9858c1 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:24.054994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c2561-0632-4dd8-8c94-d845ba9858c1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:24.054994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c2561-0632-4dd8-8c94-d845ba9858c1 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:24.056772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 679/1349] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:24.062467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:24.062934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:24.063058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:24.081116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:24.082295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:24.089971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 671/1350] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:24.114176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c2561-0632-4dd8-8c94-d845ba9858c1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:24.126302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c2561-0632-4dd8-8c94-d845ba9858c1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:24.130801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:24.131663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:24.131937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:24.132206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] PATH_INFO: `/v3/projects/bd1cb09c40f542528bcf1e352639c35a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:24.142959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] RBAC: Authorizing `identity:get_project(project_id=bd1cb09c40f542528bcf1e352639c35a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:24.145005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:24.146675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 680/1351] 10.222.0.16 () {56 vars in 1208 bytes} [Tue Aug 10 05:09:24 2021] GET /identity/v3/projects/bd1cb09c40f542528bcf1e352639c35a => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:24.152932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:24.163327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbf59-689a-45f0-8e9a-af4504082690 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:24.167821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:24.168461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:24.168741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:24.169013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:24.169761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] RBAC: Adding query filter params (scope.project.id=bd1cb09c40f542528bcf1e352639c35a) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:09:24.170092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:24.172016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:24.178464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 672/1352] 10.222.0.16 () {56 vars in 1232 bytes} [Tue Aug 10 05:09:24 2021] GET /identity/v3/role_assignments?scope.project.id=bd1cb09c40f542528bcf1e352639c35a => generated 1934 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:09:24.184800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:24.194497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f6227-5494-42c1-977c-2445e8418b11 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:24.199122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a4cba-73f4-483d-b551-bb31df8c5e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:24.199976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a4cba-73f4-483d-b551-bb31df8c5e65 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:24.200262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a4cba-73f4-483d-b551-bb31df8c5e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:24.200538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a4cba-73f4-483d-b551-bb31df8c5e65 admin admin] PATH_INFO: `/v3/users/9c21df549a3c46648a2d1e3963e9091b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:24.215039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a4cba-73f4-483d-b551-bb31df8c5e65 admin admin] RBAC: Authorizing `identity:get_user(user_id=9c21df549a3c46648a2d1e3963e9091b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:24.217801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a4cba-73f4-483d-b551-bb31df8c5e65 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:24.219725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 681/1353] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:24 2021] GET /identity/v3/users/9c21df549a3c46648a2d1e3963e9091b => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:24.225625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:24.235043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd80026-612c-49a0-a376-ad8d35a82784 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:24.239504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ab4c3-df34-4dc2-9d8d-fd81c0f5d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:24.240351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab4c3-df34-4dc2-9d8d-fd81c0f5d570 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:24.240635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab4c3-df34-4dc2-9d8d-fd81c0f5d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:24.240907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ab4c3-df34-4dc2-9d8d-fd81c0f5d570 admin admin] PATH_INFO: `/v3/users/ea2c6493cbbf4f86bef2484d6a25608e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:24.242061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ab4c3-df34-4dc2-9d8d-fd81c0f5d570 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea2c6493cbbf4f86bef2484d6a25608e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:24.243863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ab4c3-df34-4dc2-9d8d-fd81c0f5d570 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:24.245397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 673/1354] 10.222.0.16 () {56 vars in 1199 bytes} [Tue Aug 10 05:09:24 2021] GET /identity/v3/users/ea2c6493cbbf4f86bef2484d6a25608e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:09:29.491196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fe52-e08c-4315-8669-e40fff053273 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:29.491788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fe52-e08c-4315-8669-e40fff053273 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:29.491788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0fe52-e08c-4315-8669-e40fff053273 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:29.493535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 682/1355] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 10 05:09:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:29.499887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cddbf-cd78-44a1-9bc5-4de0643b84e5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:29.500289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cddbf-cd78-44a1-9bc5-4de0643b84e5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:29.500443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cddbf-cd78-44a1-9bc5-4de0643b84e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:29.517875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8e8cddbf-cd78-44a1-9bc5-4de0643b84e5 None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:29.519147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8e8cddbf-cd78-44a1-9bc5-4de0643b84e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:29.527596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 674/1356] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Aug 10 05:09:29 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:29.542892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0967c4-d32f-4f74-ae09-d6cc51060d4c None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:29.543182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0967c4-d32f-4f74-ae09-d6cc51060d4c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:29.543461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0967c4-d32f-4f74-ae09-d6cc51060d4c None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:29.545745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 683/1357] 10.222.0.16 () {54 vars in 918 bytes} [Tue Aug 10 05:09:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:29.550992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06d9c-dbd6-4f8a-9079-911a3ba0d8eb None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:29.551281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06d9c-dbd6-4f8a-9079-911a3ba0d8eb None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:29.551557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc06d9c-dbd6-4f8a-9079-911a3ba0d8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:29.569543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6cc06d9c-dbd6-4f8a-9079-911a3ba0d8eb None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:29.570767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6cc06d9c-dbd6-4f8a-9079-911a3ba0d8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:29.579937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 675/1358] 10.222.0.16 () {58 vars in 1016 bytes} [Tue Aug 10 05:09:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:32.341761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4900-b32c-48bb-b4d0-783e303bf1fb None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:32.342340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4900-b32c-48bb-b4d0-783e303bf1fb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:32.342340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f4900-b32c-48bb-b4d0-783e303bf1fb None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:32.344095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 684/1359] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:32.350006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da337d12-8005-44ad-99c0-a169fc6a49f5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:32.350393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da337d12-8005-44ad-99c0-a169fc6a49f5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:32.350562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da337d12-8005-44ad-99c0-a169fc6a49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:32.369184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-da337d12-8005-44ad-99c0-a169fc6a49f5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:32.370366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-da337d12-8005-44ad-99c0-a169fc6a49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:32.378606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 676/1360] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:32.421284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4900-b32c-48bb-b4d0-783e303bf1fb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:32.435033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f4900-b32c-48bb-b4d0-783e303bf1fb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:32.440890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd341944-9ea7-4971-b066-14f4dda36c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:32.441517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd341944-9ea7-4971-b066-14f4dda36c7d service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:32.441796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd341944-9ea7-4971-b066-14f4dda36c7d service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:32.442066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd341944-9ea7-4971-b066-14f4dda36c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:32.450250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd341944-9ea7-4971-b066-14f4dda36c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:32.451869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd341944-9ea7-4971-b066-14f4dda36c7d service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:32.460954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 685/1361] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:33.895259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f236a15-ec3d-4637-adc2-61832e7a3cf7 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:33.895823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f236a15-ec3d-4637-adc2-61832e7a3cf7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:33.895823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f236a15-ec3d-4637-adc2-61832e7a3cf7 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:33.897575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 677/1362] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:33.903047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e7c4-6ec2-42a6-be5c-3446d6629a6e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:33.903488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e7c4-6ec2-42a6-be5c-3446d6629a6e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:33.903604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e7c4-6ec2-42a6-be5c-3446d6629a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:33.921656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d7d2e7c4-6ec2-42a6-be5c-3446d6629a6e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:33.922873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d7d2e7c4-6ec2-42a6-be5c-3446d6629a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:33.930425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 686/1363] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:09:34.079698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f236a15-ec3d-4637-adc2-61832e7a3cf7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:34.093959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f236a15-ec3d-4637-adc2-61832e7a3cf7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:34.099951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05e386-a4ec-4204-b1c3-849bce225b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:34.100593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05e386-a4ec-4204-b1c3-849bce225b21 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:34.100874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05e386-a4ec-4204-b1c3-849bce225b21 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:34.101147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05e386-a4ec-4204-b1c3-849bce225b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:34.109194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05e386-a4ec-4204-b1c3-849bce225b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:34.110814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb05e386-a4ec-4204-b1c3-849bce225b21 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:34.119945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 678/1364] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:35.501660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70c8e6-2f9c-40c5-955d-b98f89971cce None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:35.502246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70c8e6-2f9c-40c5-955d-b98f89971cce None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:35.502464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70c8e6-2f9c-40c5-955d-b98f89971cce None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:35.504540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 687/1365] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:35.510132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b757-aeec-4333-b126-57a80ddc4853 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:35.510599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b757-aeec-4333-b126-57a80ddc4853 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:35.510719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b757-aeec-4333-b126-57a80ddc4853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:35.528591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9ec5b757-aeec-4333-b126-57a80ddc4853 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:35.529792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9ec5b757-aeec-4333-b126-57a80ddc4853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:35.537507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 679/1366] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:35.692020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70c8e6-2f9c-40c5-955d-b98f89971cce None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:35.706168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70c8e6-2f9c-40c5-955d-b98f89971cce None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:35.711577 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6cd3f-532a-4286-ace0-c522eec6c450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:35.712216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6cd3f-532a-4286-ace0-c522eec6c450 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:35.712503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6cd3f-532a-4286-ace0-c522eec6c450 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:35.712782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6cd3f-532a-4286-ace0-c522eec6c450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:35.721646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6cd3f-532a-4286-ace0-c522eec6c450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:35.723259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6cd3f-532a-4286-ace0-c522eec6c450 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:35.732344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 688/1367] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:37.100522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995545-7c76-4871-bd25-d9a9df0dc42d None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:37.101093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995545-7c76-4871-bd25-d9a9df0dc42d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:37.101093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea995545-7c76-4871-bd25-d9a9df0dc42d None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:37.102888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 680/1368] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:09:37.108351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8a11e-4b13-43bf-b8e4-f17e4cb02851 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:37.108743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8a11e-4b13-43bf-b8e4-f17e4cb02851 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:37.108908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8a11e-4b13-43bf-b8e4-f17e4cb02851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:37.126671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7be8a11e-4b13-43bf-b8e4-f17e4cb02851 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:37.128286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7be8a11e-4b13-43bf-b8e4-f17e4cb02851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:37.136240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 689/1369] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:37.287405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995545-7c76-4871-bd25-d9a9df0dc42d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:37.301082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea995545-7c76-4871-bd25-d9a9df0dc42d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:37.306375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49e976-c0fb-4a61-a32e-a3e1dfa7dd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:37.307037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e976-c0fb-4a61-a32e-a3e1dfa7dd11 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:37.307319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e976-c0fb-4a61-a32e-a3e1dfa7dd11 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:37.307590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49e976-c0fb-4a61-a32e-a3e1dfa7dd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:37.315808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e976-c0fb-4a61-a32e-a3e1dfa7dd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:37.317374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49e976-c0fb-4a61-a32e-a3e1dfa7dd11 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:37.327200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 681/1370] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:38.704045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2a23c-4303-4d37-9ed5-dc78f9adc74f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:38.704618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2a23c-4303-4d37-9ed5-dc78f9adc74f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:38.704618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2a23c-4303-4d37-9ed5-dc78f9adc74f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:38.706340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 690/1371] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:38.711962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3392-b04b-4e3e-9733-600bed4eed68 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:38.712406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3392-b04b-4e3e-9733-600bed4eed68 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:38.712541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3392-b04b-4e3e-9733-600bed4eed68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:38.730210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3efa3392-b04b-4e3e-9733-600bed4eed68 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:38.731486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3efa3392-b04b-4e3e-9733-600bed4eed68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:38.739780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 682/1372] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:38.891430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2a23c-4303-4d37-9ed5-dc78f9adc74f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:38.905637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2a23c-4303-4d37-9ed5-dc78f9adc74f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:38.910939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfee979-2ac5-457e-89cc-cb399e97a15e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:38.911561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee979-2ac5-457e-89cc-cb399e97a15e service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:38.911840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee979-2ac5-457e-89cc-cb399e97a15e service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:38.912108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfee979-2ac5-457e-89cc-cb399e97a15e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:38.919831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfee979-2ac5-457e-89cc-cb399e97a15e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:38.922012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfee979-2ac5-457e-89cc-cb399e97a15e service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:38.931009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 691/1373] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:40.282748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37afb-8f83-4815-89b5-868779e743fe None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:40.283310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37afb-8f83-4815-89b5-868779e743fe None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:40.283310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e37afb-8f83-4815-89b5-868779e743fe None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:40.285086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 683/1374] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:40.290506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98a29-b617-4866-8084-a4a425a3336c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:40.290921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98a29-b617-4866-8084-a4a425a3336c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:40.291103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e98a29-b617-4866-8084-a4a425a3336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:40.309061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-26e98a29-b617-4866-8084-a4a425a3336c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:40.311420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-26e98a29-b617-4866-8084-a4a425a3336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:40.318191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 692/1375] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:40.469069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37afb-8f83-4815-89b5-868779e743fe None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:40.484071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e37afb-8f83-4815-89b5-868779e743fe None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:40.489436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f438f52-e147-44ef-8899-74d2f6ff9bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:40.490066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f438f52-e147-44ef-8899-74d2f6ff9bbe service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:40.490347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f438f52-e147-44ef-8899-74d2f6ff9bbe service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:40.490643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f438f52-e147-44ef-8899-74d2f6ff9bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:40.498437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f438f52-e147-44ef-8899-74d2f6ff9bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:40.500073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f438f52-e147-44ef-8899-74d2f6ff9bbe service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:40.509076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 684/1376] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:41.872901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682477-5519-440d-8f94-dda6087d46c5 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:41.873925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682477-5519-440d-8f94-dda6087d46c5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:41.874016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b682477-5519-440d-8f94-dda6087d46c5 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:41.875852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 693/1377] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:41.881516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa93c-efbf-4dc9-8548-23e35840c15b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:41.881925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa93c-efbf-4dc9-8548-23e35840c15b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:41.882084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa93c-efbf-4dc9-8548-23e35840c15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:41.900060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6ceaa93c-efbf-4dc9-8548-23e35840c15b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:41.901261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6ceaa93c-efbf-4dc9-8548-23e35840c15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:41.909095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 685/1378] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:42.059709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682477-5519-440d-8f94-dda6087d46c5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:42.074111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b682477-5519-440d-8f94-dda6087d46c5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:42.079490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f5994-688a-4828-a5cf-9a5f295bafce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:42.080119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f5994-688a-4828-a5cf-9a5f295bafce service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:42.080404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f5994-688a-4828-a5cf-9a5f295bafce service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:42.080682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f5994-688a-4828-a5cf-9a5f295bafce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:42.088438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f5994-688a-4828-a5cf-9a5f295bafce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:42.090015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f5994-688a-4828-a5cf-9a5f295bafce service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:42.099375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 694/1379] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:43.470928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe069f-ad90-414c-9739-beb81b7ec783 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:43.471453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe069f-ad90-414c-9739-beb81b7ec783 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:43.471453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe069f-ad90-414c-9739-beb81b7ec783 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:43.473236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 686/1380] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:43.478610 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c00b7-645f-4531-901e-8c75a9b839ac None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:43.479037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c00b7-645f-4531-901e-8c75a9b839ac None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:43.479179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c00b7-645f-4531-901e-8c75a9b839ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:43.497373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-562c00b7-645f-4531-901e-8c75a9b839ac None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:43.498620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-562c00b7-645f-4531-901e-8c75a9b839ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:43.506266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 695/1381] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:43.657324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe069f-ad90-414c-9739-beb81b7ec783 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:43.671519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe069f-ad90-414c-9739-beb81b7ec783 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:43.676889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0df77b-5c90-4abf-a2eb-88c3ae57fa1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:43.677521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0df77b-5c90-4abf-a2eb-88c3ae57fa1d service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:43.677808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0df77b-5c90-4abf-a2eb-88c3ae57fa1d service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:43.678088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0df77b-5c90-4abf-a2eb-88c3ae57fa1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:43.686025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0df77b-5c90-4abf-a2eb-88c3ae57fa1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:43.687656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0df77b-5c90-4abf-a2eb-88c3ae57fa1d service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:43.697317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 687/1382] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:45.061866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583445b-61f8-4657-8fc9-e26e3d500fd8 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:45.062433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583445b-61f8-4657-8fc9-e26e3d500fd8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:45.062433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583445b-61f8-4657-8fc9-e26e3d500fd8 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:45.064256 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 696/1383] 10.222.0.16 () {54 vars in 911 bytes} [Tue Aug 10 05:09:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:45.070044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c8505-ee38-463c-b179-bfba58b9428c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:45.070444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c8505-ee38-463c-b179-bfba58b9428c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:45.070652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c8505-ee38-463c-b179-bfba58b9428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:45.088499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-753c8505-ee38-463c-b179-bfba58b9428c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:45.089690 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-753c8505-ee38-463c-b179-bfba58b9428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:45.098233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 688/1384] 10.222.0.16 () {58 vars in 1009 bytes} [Tue Aug 10 05:09:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:09:45.245854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583445b-61f8-4657-8fc9-e26e3d500fd8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:45.260558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1583445b-61f8-4657-8fc9-e26e3d500fd8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:45.266463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ee7ff-ce32-4af8-8499-a003f6bc4916 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:45.267119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee7ff-ce32-4af8-8499-a003f6bc4916 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:45.267402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee7ff-ce32-4af8-8499-a003f6bc4916 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:45.267674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ee7ff-ce32-4af8-8499-a003f6bc4916 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:45.275669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee7ff-ce32-4af8-8499-a003f6bc4916 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:45.277453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ee7ff-ce32-4af8-8499-a003f6bc4916 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:45.287338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 697/1385] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:47.294138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1be47-86b1-416d-8b63-a18b3f4ad44d None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:47.294703 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1be47-86b1-416d-8b63-a18b3f4ad44d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:47.294703 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1be47-86b1-416d-8b63-a18b3f4ad44d None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:47.296991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 689/1386] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:47.302818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717cea-dbee-4b27-a745-8e6efb7d7438 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:47.303240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717cea-dbee-4b27-a745-8e6efb7d7438 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:47.303385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06717cea-dbee-4b27-a745-8e6efb7d7438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:47.321657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-06717cea-dbee-4b27-a745-8e6efb7d7438 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:47.322940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-06717cea-dbee-4b27-a745-8e6efb7d7438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:47.330977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 698/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:47.369692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1be47-86b1-416d-8b63-a18b3f4ad44d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:47.380775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1be47-86b1-416d-8b63-a18b3f4ad44d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:47.384313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12fbc5e-6acc-4511-96fb-8339c0ca8adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:47.384955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc5e-6acc-4511-96fb-8339c0ca8adf service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:47.385236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc5e-6acc-4511-96fb-8339c0ca8adf service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:47.385508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbc5e-6acc-4511-96fb-8339c0ca8adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:47.394112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc5e-6acc-4511-96fb-8339c0ca8adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:47.395586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12fbc5e-6acc-4511-96fb-8339c0ca8adf service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:47.404677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 690/1388] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:49.639158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8073b32-5e8e-4708-bb88-d963a83b446e None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:49.639683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8073b32-5e8e-4708-bb88-d963a83b446e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:49.639774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8073b32-5e8e-4708-bb88-d963a83b446e None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:49.641506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 699/1389] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:49.647241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9a139-9360-4008-9a32-f61d676c3eca None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:49.647695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9a139-9360-4008-9a32-f61d676c3eca None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:49.647800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e9a139-9360-4008-9a32-f61d676c3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:49.665041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-29e9a139-9360-4008-9a32-f61d676c3eca None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:49.666228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-29e9a139-9360-4008-9a32-f61d676c3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:49.674465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 691/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:09:49.712535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8073b32-5e8e-4708-bb88-d963a83b446e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:49.723165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8073b32-5e8e-4708-bb88-d963a83b446e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:49.726617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6d269-b04f-4ef5-9dc8-ff96db3f25a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:49.727245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6d269-b04f-4ef5-9dc8-ff96db3f25a4 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:49.727528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6d269-b04f-4ef5-9dc8-ff96db3f25a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:49.727801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6d269-b04f-4ef5-9dc8-ff96db3f25a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:49.736833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6d269-b04f-4ef5-9dc8-ff96db3f25a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:49.738253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6d269-b04f-4ef5-9dc8-ff96db3f25a4 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:49.747233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 700/1391] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:09:52.221369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342317e-c206-4365-952c-41107a44a84c None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:52.221958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342317e-c206-4365-952c-41107a44a84c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:52.221958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342317e-c206-4365-952c-41107a44a84c None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:52.223741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 692/1392] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:52.229649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9f75-5d4e-439b-b44e-ae1acfa349e3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:52.230101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9f75-5d4e-439b-b44e-ae1acfa349e3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:52.230312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd9f75-5d4e-439b-b44e-ae1acfa349e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:52.248252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-34fd9f75-5d4e-439b-b44e-ae1acfa349e3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:52.249427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-34fd9f75-5d4e-439b-b44e-ae1acfa349e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:52.257112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 701/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:52.297152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342317e-c206-4365-952c-41107a44a84c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:52.299129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c342317e-c206-4365-952c-41107a44a84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:52.311614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342317e-c206-4365-952c-41107a44a84c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:52.317314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd863f0-0599-4be3-87e5-4df16a20c711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:52.317970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd863f0-0599-4be3-87e5-4df16a20c711 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:52.318257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd863f0-0599-4be3-87e5-4df16a20c711 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:52.318536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd863f0-0599-4be3-87e5-4df16a20c711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:52.327924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd863f0-0599-4be3-87e5-4df16a20c711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:52.329352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd863f0-0599-4be3-87e5-4df16a20c711 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:52.338589 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 693/1394] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:54.561525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e520e1-354d-4678-834d-627e6e0af588 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:54.562031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e520e1-354d-4678-834d-627e6e0af588 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:54.562147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e520e1-354d-4678-834d-627e6e0af588 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:54.563923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 702/1395] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:54.569945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf15c8-b121-449a-a6e2-721743a26915 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:54.570350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf15c8-b121-449a-a6e2-721743a26915 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:54.570503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cf15c8-b121-449a-a6e2-721743a26915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:54.587737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c8cf15c8-b121-449a-a6e2-721743a26915 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:54.588909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c8cf15c8-b121-449a-a6e2-721743a26915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:54.597290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 694/1396] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:54.638006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e520e1-354d-4678-834d-627e6e0af588 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:54.648466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e520e1-354d-4678-834d-627e6e0af588 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:54.652031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3e3f-9f7d-4cac-b059-3a25e4c6f123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:54.652662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3e3f-9f7d-4cac-b059-3a25e4c6f123 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:54.652947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3e3f-9f7d-4cac-b059-3a25e4c6f123 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:54.653226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3e3f-9f7d-4cac-b059-3a25e4c6f123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:54.662372 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3e3f-9f7d-4cac-b059-3a25e4c6f123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:54.663848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3e3f-9f7d-4cac-b059-3a25e4c6f123 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:54.673562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 703/1397] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:56.833019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765a830-6434-4fa6-b96b-23acb5eaf020 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:56.833576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765a830-6434-4fa6-b96b-23acb5eaf020 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:56.833576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765a830-6434-4fa6-b96b-23acb5eaf020 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:56.835337 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 695/1398] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:56.841065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10095-720b-4d19-b9e7-40c565da44b2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:56.841619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10095-720b-4d19-b9e7-40c565da44b2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:56.841730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d10095-720b-4d19-b9e7-40c565da44b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:56.859354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-81d10095-720b-4d19-b9e7-40c565da44b2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:56.860533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-81d10095-720b-4d19-b9e7-40c565da44b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:56.868248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 704/1399] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:56.907543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765a830-6434-4fa6-b96b-23acb5eaf020 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:56.918025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765a830-6434-4fa6-b96b-23acb5eaf020 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:56.921615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7018e63-18fd-4c3f-9291-2b0d6e949d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:56.922250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018e63-18fd-4c3f-9291-2b0d6e949d98 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:56.922536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018e63-18fd-4c3f-9291-2b0d6e949d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:56.922851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7018e63-18fd-4c3f-9291-2b0d6e949d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:56.931494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018e63-18fd-4c3f-9291-2b0d6e949d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:56.932933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7018e63-18fd-4c3f-9291-2b0d6e949d98 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:56.942642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 696/1400] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:09:59.099685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd934a-5586-40ac-b21e-791650aa53c4 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:59.100247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd934a-5586-40ac-b21e-791650aa53c4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:59.100247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd934a-5586-40ac-b21e-791650aa53c4 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:59.102015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 705/1401] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:09:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:09:59.107952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d352-dc1d-4bf9-ac0b-4601a70c7d8e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:59.108378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d352-dc1d-4bf9-ac0b-4601a70c7d8e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:59.108510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d352-dc1d-4bf9-ac0b-4601a70c7d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:59.126182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-40f5d352-dc1d-4bf9-ac0b-4601a70c7d8e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:09:59.127394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-40f5d352-dc1d-4bf9-ac0b-4601a70c7d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:09:59.135072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 697/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:09:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:09:59.172891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd934a-5586-40ac-b21e-791650aa53c4 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:09:59.183260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd934a-5586-40ac-b21e-791650aa53c4 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:09:59.187324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f45db9-f53a-4a91-90af-bad38618e9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:09:59.187953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f45db9-f53a-4a91-90af-bad38618e9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:09:59.188236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f45db9-f53a-4a91-90af-bad38618e9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:09:59.188511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f45db9-f53a-4a91-90af-bad38618e9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:09:59.197024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f45db9-f53a-4a91-90af-bad38618e9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:09:59.198451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f45db9-f53a-4a91-90af-bad38618e9b4 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:09:59.207980 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 706/1403] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:09:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:01.371061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1d271-1588-49c6-bfba-2b6b107e6dc5 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:01.371626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1d271-1588-49c6-bfba-2b6b107e6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:01.371626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1d271-1588-49c6-bfba-2b6b107e6dc5 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:01.373517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 698/1404] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:01.379329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c410572-9d00-48a7-bccc-399c2592c7fc None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:01.379776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c410572-9d00-48a7-bccc-399c2592c7fc None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:01.379880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c410572-9d00-48a7-bccc-399c2592c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:01.402192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0c410572-9d00-48a7-bccc-399c2592c7fc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:01.403423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0c410572-9d00-48a7-bccc-399c2592c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:01.414305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 707/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:01.452386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1d271-1588-49c6-bfba-2b6b107e6dc5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:01.462951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1d271-1588-49c6-bfba-2b6b107e6dc5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:01.466473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efa03-ae60-49e8-810e-f9b944177267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:01.467717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efa03-ae60-49e8-810e-f9b944177267 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:01.468001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efa03-ae60-49e8-810e-f9b944177267 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:01.468279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efa03-ae60-49e8-810e-f9b944177267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:01.477236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efa03-ae60-49e8-810e-f9b944177267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:01.478739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efa03-ae60-49e8-810e-f9b944177267 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:01.488634 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 699/1406] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:03.652946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48542127-4a54-414f-8dca-dcb05a601911 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:03.653493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48542127-4a54-414f-8dca-dcb05a601911 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:03.653493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48542127-4a54-414f-8dca-dcb05a601911 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:03.655442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 708/1407] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:10:03.661216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255fcf-033b-4553-99e3-37a2c2b96a9d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:03.661611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255fcf-033b-4553-99e3-37a2c2b96a9d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:03.661765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255fcf-033b-4553-99e3-37a2c2b96a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:03.679003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-98255fcf-033b-4553-99e3-37a2c2b96a9d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:03.680117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-98255fcf-033b-4553-99e3-37a2c2b96a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:03.688337 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 700/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:03.726187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48542127-4a54-414f-8dca-dcb05a601911 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:03.736798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48542127-4a54-414f-8dca-dcb05a601911 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:03.740327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26a22a-3fdd-41bb-8199-b9bca49a01ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:03.740961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a22a-3fdd-41bb-8199-b9bca49a01ba service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:03.741245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a22a-3fdd-41bb-8199-b9bca49a01ba service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:03.741521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26a22a-3fdd-41bb-8199-b9bca49a01ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:03.750791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26a22a-3fdd-41bb-8199-b9bca49a01ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:03.752247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26a22a-3fdd-41bb-8199-b9bca49a01ba service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:03.761295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 709/1409] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:05.850831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f09ce-2266-49d6-a677-bf75d11fc87c None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:05.851409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f09ce-2266-49d6-a677-bf75d11fc87c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:05.851409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f09ce-2266-49d6-a677-bf75d11fc87c None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:05.853149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 701/1410] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:05.859503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cac6c-0115-4c85-9c13-e126d41e4ce3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:05.859930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cac6c-0115-4c85-9c13-e126d41e4ce3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:05.860044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cac6c-0115-4c85-9c13-e126d41e4ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:05.877472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-265cac6c-0115-4c85-9c13-e126d41e4ce3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:05.878690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-265cac6c-0115-4c85-9c13-e126d41e4ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:05.886347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 710/1411] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:05.923604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f09ce-2266-49d6-a677-bf75d11fc87c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:05.934080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f09ce-2266-49d6-a677-bf75d11fc87c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:05.937682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72390ca3-027a-4348-9da2-8e661ef2d049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:05.938312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390ca3-027a-4348-9da2-8e661ef2d049 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:05.938673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390ca3-027a-4348-9da2-8e661ef2d049 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:05.939035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72390ca3-027a-4348-9da2-8e661ef2d049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:05.949458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72390ca3-027a-4348-9da2-8e661ef2d049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:05.951685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72390ca3-027a-4348-9da2-8e661ef2d049 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:05.963064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 702/1412] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:08.067126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93901b-8128-466e-ac26-ad202b94b619 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:08.067690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93901b-8128-466e-ac26-ad202b94b619 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:08.067789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa93901b-8128-466e-ac26-ad202b94b619 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:08.069537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 711/1413] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:08.075429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c919b0-0d5c-4d71-8b25-93ad7df0ea28 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:08.075864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c919b0-0d5c-4d71-8b25-93ad7df0ea28 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:08.076011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c919b0-0d5c-4d71-8b25-93ad7df0ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:08.093664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-80c919b0-0d5c-4d71-8b25-93ad7df0ea28 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:08.094877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-80c919b0-0d5c-4d71-8b25-93ad7df0ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:08.102700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 703/1414] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:08.139905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93901b-8128-466e-ac26-ad202b94b619 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:08.150299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa93901b-8128-466e-ac26-ad202b94b619 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:08.153835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee87d83-da9c-4669-95b9-419d608b0075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:08.155059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87d83-da9c-4669-95b9-419d608b0075 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:08.155348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87d83-da9c-4669-95b9-419d608b0075 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:08.155627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee87d83-da9c-4669-95b9-419d608b0075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:08.164315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee87d83-da9c-4669-95b9-419d608b0075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:08.165747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee87d83-da9c-4669-95b9-419d608b0075 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:08.175602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 712/1415] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:28.239990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1fab-a465-476f-9787-ff6b4d5da265 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:28.240565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1fab-a465-476f-9787-ff6b4d5da265 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:28.240565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c1fab-a465-476f-9787-ff6b4d5da265 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:28.242229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 704/1416] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:28.248543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7703f-c000-4d8b-8946-ebad0cd7f9da None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:28.248941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7703f-c000-4d8b-8946-ebad0cd7f9da None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:28.249108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7703f-c000-4d8b-8946-ebad0cd7f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:28.266951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7ff7703f-c000-4d8b-8946-ebad0cd7f9da None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:28.268141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7ff7703f-c000-4d8b-8946-ebad0cd7f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:28.275948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 713/1417] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:28.323307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5be575-d952-492a-8fe9-9b46bb158b29 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:28.323592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5be575-d952-492a-8fe9-9b46bb158b29 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:28.323866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5be575-d952-492a-8fe9-9b46bb158b29 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:28.325596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 705/1418] 10.222.0.16 () {54 vars in 966 bytes} [Tue Aug 10 05:10:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:28.331300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6108b8-0b1f-4730-bd1d-e2bc8f84ea76 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:28.331595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6108b8-0b1f-4730-bd1d-e2bc8f84ea76 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:28.331873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6108b8-0b1f-4730-bd1d-e2bc8f84ea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:28.349867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8a6108b8-0b1f-4730-bd1d-e2bc8f84ea76 None None] MFA Rules not processed for user `5350c5f195db471189281bf10b9cd9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:28.351096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8a6108b8-0b1f-4730-bd1d-e2bc8f84ea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:28.357568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 714/1419] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 10 05:10:28 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:28.364861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5be575-d952-492a-8fe9-9b46bb158b29 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:28.375982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5be575-d952-492a-8fe9-9b46bb158b29 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:28.379574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc877b-e99a-4ad9-9a57-4dd9c4d5fdbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:28.380188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc877b-e99a-4ad9-9a57-4dd9c4d5fdbb service glance] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:28.380476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc877b-e99a-4ad9-9a57-4dd9c4d5fdbb service glance] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:28.380753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc877b-e99a-4ad9-9a57-4dd9c4d5fdbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:28.390204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc877b-e99a-4ad9-9a57-4dd9c4d5fdbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:28.391663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc877b-e99a-4ad9-9a57-4dd9c4d5fdbb service glance] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:28.400809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 706/1420] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:30.617762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09cae-aa04-4d31-a496-46cadd361860 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:30.618343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09cae-aa04-4d31-a496-46cadd361860 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:30.618343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce09cae-aa04-4d31-a496-46cadd361860 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:30.620136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 715/1421] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:30.626067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf905-38a5-4b0f-985a-6cef6fc56137 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:30.626469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf905-38a5-4b0f-985a-6cef6fc56137 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:30.626657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eaf905-38a5-4b0f-985a-6cef6fc56137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:30.644141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-59eaf905-38a5-4b0f-985a-6cef6fc56137 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:30.645335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-59eaf905-38a5-4b0f-985a-6cef6fc56137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:30.653059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 707/1422] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:30.677986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09cae-aa04-4d31-a496-46cadd361860 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:30.690187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce09cae-aa04-4d31-a496-46cadd361860 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:30.694563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e91abb-2605-434e-acc1-ed34289eb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:30.695222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e91abb-2605-434e-acc1-ed34289eb2bc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:30.695503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e91abb-2605-434e-acc1-ed34289eb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:30.695777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e91abb-2605-434e-acc1-ed34289eb2bc admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:30.696495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e91abb-2605-434e-acc1-ed34289eb2bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:30.698326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e91abb-2605-434e-acc1-ed34289eb2bc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:30.711486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 716/1423] 10.222.0.16 () {56 vars in 1109 bytes} [Tue Aug 10 05:10:30 2021] GET /identity/v3/projects => generated 2553 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:10:32.826536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49c313-a506-4658-a7d9-eb8763367834 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:32.827208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49c313-a506-4658-a7d9-eb8763367834 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:32.827208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49c313-a506-4658-a7d9-eb8763367834 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:32.828864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 708/1424] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:32.834958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b79b-d637-42b3-89d5-784fe25f21b0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:32.835428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b79b-d637-42b3-89d5-784fe25f21b0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:32.835591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f9b79b-d637-42b3-89d5-784fe25f21b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:32.854884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-19f9b79b-d637-42b3-89d5-784fe25f21b0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:32.856085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-19f9b79b-d637-42b3-89d5-784fe25f21b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:32.864451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 717/1425] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:32.908355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49c313-a506-4658-a7d9-eb8763367834 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:32.922244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49c313-a506-4658-a7d9-eb8763367834 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:32.927632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c425c-a6db-40d1-9d14-748157c2e3d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:32.928263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c425c-a6db-40d1-9d14-748157c2e3d0 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:32.928546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c425c-a6db-40d1-9d14-748157c2e3d0 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:32.928821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c425c-a6db-40d1-9d14-748157c2e3d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:32.937138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c425c-a6db-40d1-9d14-748157c2e3d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:32.938745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c425c-a6db-40d1-9d14-748157c2e3d0 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:32.947784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 709/1426] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:35.199039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf618e3-5ca9-45a7-9c1a-d81ef8e39511 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:35.199630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf618e3-5ca9-45a7-9c1a-d81ef8e39511 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:35.199630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf618e3-5ca9-45a7-9c1a-d81ef8e39511 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:35.201523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 718/1427] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:35.207296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a5dc-4664-4e59-b066-96e0b74efe0f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:35.207742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a5dc-4664-4e59-b066-96e0b74efe0f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:35.207933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427a5dc-4664-4e59-b066-96e0b74efe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:35.226187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f427a5dc-4664-4e59-b066-96e0b74efe0f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:35.227396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f427a5dc-4664-4e59-b066-96e0b74efe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:35.235740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 710/1428] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:35.272781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf618e3-5ca9-45a7-9c1a-d81ef8e39511 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:35.283766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf618e3-5ca9-45a7-9c1a-d81ef8e39511 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:35.287484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b00c25-f591-42c1-aabb-8f41fba5c424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:35.294564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00c25-f591-42c1-aabb-8f41fba5c424 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:35.294564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00c25-f591-42c1-aabb-8f41fba5c424 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:35.294564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00c25-f591-42c1-aabb-8f41fba5c424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:35.297566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b00c25-f591-42c1-aabb-8f41fba5c424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:35.299020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b00c25-f591-42c1-aabb-8f41fba5c424 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:35.308349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 719/1429] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:37.474435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47e6b-36ec-4030-90ca-66582ead0e6a None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:37.474923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47e6b-36ec-4030-90ca-66582ead0e6a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:37.475023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a47e6b-36ec-4030-90ca-66582ead0e6a None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:37.476835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 711/1430] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:37.483381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684c3f8-ceed-47cf-a5d3-013eb1743d88 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:37.483809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684c3f8-ceed-47cf-a5d3-013eb1743d88 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:37.483924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684c3f8-ceed-47cf-a5d3-013eb1743d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:37.501134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8684c3f8-ceed-47cf-a5d3-013eb1743d88 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:37.502317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8684c3f8-ceed-47cf-a5d3-013eb1743d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:37.509896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 720/1431] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:37.548676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47e6b-36ec-4030-90ca-66582ead0e6a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:37.559279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a47e6b-36ec-4030-90ca-66582ead0e6a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:37.562812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35524913-0c6e-4e3e-9c5d-d8f4c4912bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:37.563450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35524913-0c6e-4e3e-9c5d-d8f4c4912bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:37.563731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35524913-0c6e-4e3e-9c5d-d8f4c4912bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:37.564008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35524913-0c6e-4e3e-9c5d-d8f4c4912bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:37.572662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35524913-0c6e-4e3e-9c5d-d8f4c4912bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:37.574119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35524913-0c6e-4e3e-9c5d-d8f4c4912bc7 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:37.583889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 712/1432] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:39.838428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602313e8-26a4-48ac-b101-d589d686f3b4 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:39.839022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602313e8-26a4-48ac-b101-d589d686f3b4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:39.839022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602313e8-26a4-48ac-b101-d589d686f3b4 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:39.840795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 721/1433] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:39.847458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953cfc8-7c0b-4080-bbf6-f7879ebaf0a8 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:39.847863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953cfc8-7c0b-4080-bbf6-f7879ebaf0a8 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:39.848018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953cfc8-7c0b-4080-bbf6-f7879ebaf0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:39.866177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e953cfc8-7c0b-4080-bbf6-f7879ebaf0a8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:39.867411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e953cfc8-7c0b-4080-bbf6-f7879ebaf0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:39.875306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 713/1434] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:39.916365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602313e8-26a4-48ac-b101-d589d686f3b4 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:39.926905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602313e8-26a4-48ac-b101-d589d686f3b4 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:39.930419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb1e11-62a1-41ae-aa5c-0a1a847deacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:39.931078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1e11-62a1-41ae-aa5c-0a1a847deacb service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:39.931361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1e11-62a1-41ae-aa5c-0a1a847deacb service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:39.931634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb1e11-62a1-41ae-aa5c-0a1a847deacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:39.940476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1e11-62a1-41ae-aa5c-0a1a847deacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:39.942117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb1e11-62a1-41ae-aa5c-0a1a847deacb service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:39.952041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 722/1435] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:10:42.475358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a607a2-c0c1-493e-ae1c-b805a977281d None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:42.475929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a607a2-c0c1-493e-ae1c-b805a977281d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:42.475929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a607a2-c0c1-493e-ae1c-b805a977281d None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:42.477728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 714/1436] 10.222.0.16 () {54 vars in 926 bytes} [Tue Aug 10 05:10:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:10:42.484294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece62af-9a88-4df5-b09c-192f84bb68e9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:42.484713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece62af-9a88-4df5-b09c-192f84bb68e9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:42.484855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece62af-9a88-4df5-b09c-192f84bb68e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:42.502095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-dece62af-9a88-4df5-b09c-192f84bb68e9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:10:42.503329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-dece62af-9a88-4df5-b09c-192f84bb68e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:10:42.510945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 723/1437] 10.222.0.16 () {58 vars in 1024 bytes} [Tue Aug 10 05:10:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:10:42.551456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a607a2-c0c1-493e-ae1c-b805a977281d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:10:42.561884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a607a2-c0c1-493e-ae1c-b805a977281d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:10:42.565364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebecffc0-cbb2-4091-b06d-89d42e8bfa25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:10:42.565990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecffc0-cbb2-4091-b06d-89d42e8bfa25 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:10:42.566271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecffc0-cbb2-4091-b06d-89d42e8bfa25 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:10:42.566545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebecffc0-cbb2-4091-b06d-89d42e8bfa25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:10:42.575106 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecffc0-cbb2-4091-b06d-89d42e8bfa25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:10:42.576583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebecffc0-cbb2-4091-b06d-89d42e8bfa25 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:10:42.585743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 715/1438] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:10:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:12:18.232590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.233176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.233176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.250801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:12:18.252025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:12:18.259837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 724/1439] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:12:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:12:18.268057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.268535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.268643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.286323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:12:18.287523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:12:18.295156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 716/1440] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:12:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:12:18.299462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:18.308701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4d8cb-8c8c-4eef-9324-8e9740f998d2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:18.313175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:18.314328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.314635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.314912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.315631 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:12:18.315937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:18.317527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:18.328513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 725/1441] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:12:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:12:18.336791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:18.345594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1ea64-f6b7-4212-a3af-de4a940a5ec1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:18.350120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:18.351047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.351332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.351603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.352285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:18.354256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:18.515960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 717/1442] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:12:18 2021] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:12:18.520710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:18.531073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d351f-7138-41bd-8bd8-2dc74bc39ffd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:18.584119 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:18.584790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.585076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.585352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.586043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:18.587986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:18.668203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 726/1443] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:12:18 2021] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:12:18.672195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:18.682833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1772d2bd-9836-42da-93e5-73045bfdcfce admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:18.687362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:18.688017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.688306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.688608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.689948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:18.691570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:18.703781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 718/1444] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:12:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:12:18.709367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:18.719171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02725fc4-28f6-418b-bc91-76fec32f3826 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:18.723684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00818a46-2bbe-4223-ad8e-2ba96dccd7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:18.724331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00818a46-2bbe-4223-ad8e-2ba96dccd7cc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.724614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00818a46-2bbe-4223-ad8e-2ba96dccd7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.724889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00818a46-2bbe-4223-ad8e-2ba96dccd7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.725881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00818a46-2bbe-4223-ad8e-2ba96dccd7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:18.727499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00818a46-2bbe-4223-ad8e-2ba96dccd7cc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:18.740773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 727/1445] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:12:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:12:18.744557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:18.754978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2dfdd1-6c63-49fa-a8a6-0b3923c4353e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:18.759598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:18.760466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.760748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.761023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] PATH_INFO: `/v3/projects/cb292a1d95f54985b09d5be6caec2d03/users/21cd13abfdb9482d9abecada6a24a949/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.775187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb292a1d95f54985b09d5be6caec2d03, user_id=21cd13abfdb9482d9abecada6a24a949, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:18.777778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:18.828315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 719/1446] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:12:18 2021] PUT /identity/v3/projects/cb292a1d95f54985b09d5be6caec2d03/users/21cd13abfdb9482d9abecada6a24a949/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:12:18.840035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5640-7b06-4fae-a226-5d28fd16d018 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:18.840335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5640-7b06-4fae-a226-5d28fd16d018 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:18.840619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd5640-7b06-4fae-a226-5d28fd16d018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:18.867016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-92cd5640-7b06-4fae-a226-5d28fd16d018 None None] MFA Rules not processed for user `21cd13abfdb9482d9abecada6a24a949`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:12:18.868228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-92cd5640-7b06-4fae-a226-5d28fd16d018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:12:18.928713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 728/1447] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:12:18 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:12:18.940995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:19.007513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb6b6f-b5eb-400c-a75a-9842e57a3262 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:19.012891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:19.013533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:19.013816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:19.014089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:19.021502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:19.023125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:19.031698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 720/1448] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:12:18 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:12:19.098561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0e82-87a8-4d4d-8648-f9fe220ee4c9 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:19.098881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0e82-87a8-4d4d-8648-f9fe220ee4c9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:19.099159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb0e82-87a8-4d4d-8648-f9fe220ee4c9 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:19.101140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 729/1449] 10.222.0.16 () {52 vars in 829 bytes} [Tue Aug 10 05:12:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:12:19.104706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:19.163653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584e10ea-ac2f-4582-8ba7-6e1e9ead1775 service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:19.168279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:19.169147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:19.169460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:19.169753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] PATH_INFO: `/v3/users/21cd13abfdb9482d9abecada6a24a949` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:19.170940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21cd13abfdb9482d9abecada6a24a949)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:19.171953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:12:19.171953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 05:12:19.171953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 05:12:19.173781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:19.364635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21cd13abfdb9482d9abecada6a24a949'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:19.384140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21cd13abfdb9482d9abecada6a24a949'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:19.456646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21cd13abfdb9482d9abecada6a24a949'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:19.470689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21cd13abfdb9482d9abecada6a24a949'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:19.471368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21cd13abfdb9482d9abecada6a24a949'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:19.477763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 721/1450] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:12:19 2021] DELETE /identity/v3/users/21cd13abfdb9482d9abecada6a24a949 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:12:19.482523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:19.483122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:19.483225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:19.500223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:12:19.501527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:12:19.558289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 730/1451] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:12:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:12:19.568148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:19.569566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:12:19.623757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98c63f-478d-47b5-a2f5-1534eeb4117c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:19.627304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2369c-3798-4ac1-b479-ba70ad1bf2f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:19.627943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2369c-3798-4ac1-b479-ba70ad1bf2f9 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:19.628225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2369c-3798-4ac1-b479-ba70ad1bf2f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:19.628501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2369c-3798-4ac1-b479-ba70ad1bf2f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:19.637155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2369c-3798-4ac1-b479-ba70ad1bf2f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:19.638599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2369c-3798-4ac1-b479-ba70ad1bf2f9 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:19.648321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 722/1452] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:12:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:12:20.116654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:12:20.118181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:12:20.130053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7775f-e8e6-48c9-a4b6-2b91b68ec100 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:12:20.134671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:12:20.135482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:12:20.135833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:12:20.136012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] PATH_INFO: `/v3/projects/cb292a1d95f54985b09d5be6caec2d03` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:12:20.137265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb292a1d95f54985b09d5be6caec2d03)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:12:20.138294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:12:20.138294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 05:12:20.138294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 05:12:20.139539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:12:20.256425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb292a1d95f54985b09d5be6caec2d03', 'request_id': 'req-edb69eff-76cd-49b3-a05e-d927d43900ae'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:20.270595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb292a1d95f54985b09d5be6caec2d03', 'request_id': 'req-edb69eff-76cd-49b3-a05e-d927d43900ae'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:20.359025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb292a1d95f54985b09d5be6caec2d03', 'request_id': 'req-edb69eff-76cd-49b3-a05e-d927d43900ae'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:20.370194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] The token cache is being invalidate because project cb292a1d95f54985b09d5be6caec2d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:12:20.370757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:20.371163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-edb69eff-76cd-49b3-a05e-d927d43900ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:12:20.372835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 731/1453] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:12:20 2021] DELETE /identity/v3/projects/cb292a1d95f54985b09d5be6caec2d03 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:13:45.692843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28539-4823-4fb1-87fa-9be29da4e698 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:45.693434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28539-4823-4fb1-87fa-9be29da4e698 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:45.693434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da28539-4823-4fb1-87fa-9be29da4e698 None None] PATH_INFO: `/v3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:45.694676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 723/1454] 10.222.0.35 () {54 vars in 926 bytes} [Tue Aug 10 05:13:45 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:13:45.721913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590db7a-a6e7-4963-9891-cbc185146f83 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:45.722387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590db7a-a6e7-4963-9891-cbc185146f83 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:45.722529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590db7a-a6e7-4963-9891-cbc185146f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:45.740660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b590db7a-a6e7-4963-9891-cbc185146f83 None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:13:45.741866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b590db7a-a6e7-4963-9891-cbc185146f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:45.800736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 732/1455] 10.222.0.35 () {58 vars in 1016 bytes} [Tue Aug 10 05:13:45 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:13:49.156781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0476f2-bfac-4004-bc15-c408563732dc None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:49.157216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0476f2-bfac-4004-bc15-c408563732dc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:49.157335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0476f2-bfac-4004-bc15-c408563732dc None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:49.159123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 724/1456] 10.222.0.16 () {54 vars in 960 bytes} [Tue Aug 10 05:13:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:13:49.164487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4618b-b42f-4015-b0c4-8f904b46a706 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:49.164946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4618b-b42f-4015-b0c4-8f904b46a706 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:49.165053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4618b-b42f-4015-b0c4-8f904b46a706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:49.183038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b8b4618b-b42f-4015-b0c4-8f904b46a706 None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:13:49.184290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b8b4618b-b42f-4015-b0c4-8f904b46a706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:49.193061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 733/1457] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 10 05:13:49 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:13:49.201402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0476f2-bfac-4004-bc15-c408563732dc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:13:49.216442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0476f2-bfac-4004-bc15-c408563732dc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:13:49.221516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d24d8-e2d4-460a-984a-cb6d409fdc4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:13:49.222188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d24d8-e2d4-460a-984a-cb6d409fdc4a service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:49.222471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d24d8-e2d4-460a-984a-cb6d409fdc4a service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:49.222779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d24d8-e2d4-460a-984a-cb6d409fdc4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:49.231792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d24d8-e2d4-460a-984a-cb6d409fdc4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:13:49.233665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d24d8-e2d4-460a-984a-cb6d409fdc4a service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:13:49.244169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 725/1458] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:13:49 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:13:50.016194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fef7b3-7247-4ffa-a258-e3027d6dd479 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:50.016482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fef7b3-7247-4ffa-a258-e3027d6dd479 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:50.016758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fef7b3-7247-4ffa-a258-e3027d6dd479 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:50.018565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 10 05:13:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:13:50.023726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cb176-bdf8-4f35-8a14-4bde294aad9c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:50.024016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cb176-bdf8-4f35-8a14-4bde294aad9c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:50.024293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cb176-bdf8-4f35-8a14-4bde294aad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:50.041763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-591cb176-bdf8-4f35-8a14-4bde294aad9c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:13:50.042987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-591cb176-bdf8-4f35-8a14-4bde294aad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:50.097470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 10 05:13:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:13:50.248749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fef7b3-7247-4ffa-a258-e3027d6dd479 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:13:50.250397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b1fef7b3-7247-4ffa-a258-e3027d6dd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:50.321164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fef7b3-7247-4ffa-a258-e3027d6dd479 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:13:50.327062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935cc3d-8d28-4c5c-9368-ea82510f5d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:13:50.327703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cc3d-8d28-4c5c-9368-ea82510f5d72 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:50.327985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cc3d-8d28-4c5c-9368-ea82510f5d72 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:50.328258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935cc3d-8d28-4c5c-9368-ea82510f5d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:50.336090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935cc3d-8d28-4c5c-9368-ea82510f5d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:13:50.337709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935cc3d-8d28-4c5c-9368-ea82510f5d72 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:13:50.346966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 735/1461] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:13:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:13:51.685269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a824-0ab4-4952-a92a-941fdb4a18c7 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:51.685856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a824-0ab4-4952-a92a-941fdb4a18c7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:51.685856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a824-0ab4-4952-a92a-941fdb4a18c7 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:51.687608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 10 05:13:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:13:51.692744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce837e1-5888-4f0b-b2e6-88e5ab27b762 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:51.693125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce837e1-5888-4f0b-b2e6-88e5ab27b762 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:51.693308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce837e1-5888-4f0b-b2e6-88e5ab27b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:51.711975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1ce837e1-5888-4f0b-b2e6-88e5ab27b762 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:13:51.714236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1ce837e1-5888-4f0b-b2e6-88e5ab27b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:51.722392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 999 bytes} [Tue Aug 10 05:13:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:13:51.877999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a824-0ab4-4952-a92a-941fdb4a18c7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:13:51.892279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a824-0ab4-4952-a92a-941fdb4a18c7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:13:51.897664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e4104-a93a-46c2-aa49-11f5e76ef09a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:13:51.898302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4104-a93a-46c2-aa49-11f5e76ef09a service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:51.898607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4104-a93a-46c2-aa49-11f5e76ef09a service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:51.898884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e4104-a93a-46c2-aa49-11f5e76ef09a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:51.906850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e4104-a93a-46c2-aa49-11f5e76ef09a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:13:51.908474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e4104-a93a-46c2-aa49-11f5e76ef09a service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:13:51.918203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 728/1464] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:13:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:13:56.083939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d154-b50f-4fa6-adf4-1011a2830639 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:56.084512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d154-b50f-4fa6-adf4-1011a2830639 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:56.084512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829d154-b50f-4fa6-adf4-1011a2830639 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:56.086696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 05:13:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:13:56.092902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa849f4-256c-4751-bdf6-c39a481932c7 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:56.093331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa849f4-256c-4751-bdf6-c39a481932c7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:56.093534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa849f4-256c-4751-bdf6-c39a481932c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:56.114071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-daa849f4-256c-4751-bdf6-c39a481932c7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:13:56.115350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-daa849f4-256c-4751-bdf6-c39a481932c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:56.123385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 05:13:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:13:56.160150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d154-b50f-4fa6-adf4-1011a2830639 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:13:56.161879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a829d154-b50f-4fa6-adf4-1011a2830639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:56.216798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829d154-b50f-4fa6-adf4-1011a2830639 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:13:56.220389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf45911-db13-4422-a586-badf0ab28fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:13:56.221024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45911-db13-4422-a586-badf0ab28fab service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:56.221308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45911-db13-4422-a586-badf0ab28fab service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:56.221581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf45911-db13-4422-a586-badf0ab28fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:56.231031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45911-db13-4422-a586-badf0ab28fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:13:56.232471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf45911-db13-4422-a586-badf0ab28fab service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:13:56.241537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 738/1467] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:13:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:13:58.343922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34633-f302-4f55-aede-3ee7b8824f83 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:58.344492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34633-f302-4f55-aede-3ee7b8824f83 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:58.344492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34633-f302-4f55-aede-3ee7b8824f83 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:58.346252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 05:13:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:13:58.351802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81e198-d6c5-4746-9b8c-169258d749f9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:58.352235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81e198-d6c5-4746-9b8c-169258d749f9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:58.352342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81e198-d6c5-4746-9b8c-169258d749f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:58.372101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7a81e198-d6c5-4746-9b8c-169258d749f9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:13:58.373300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7a81e198-d6c5-4746-9b8c-169258d749f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:58.381025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 05:13:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:13:58.419827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34633-f302-4f55-aede-3ee7b8824f83 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:13:58.421522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0bd34633-f302-4f55-aede-3ee7b8824f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:13:58.435284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34633-f302-4f55-aede-3ee7b8824f83 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:13:58.438847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dfcf1-fa09-4ace-bcfd-82950dbe025d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:13:58.439486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dfcf1-fa09-4ace-bcfd-82950dbe025d service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:13:58.439771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dfcf1-fa09-4ace-bcfd-82950dbe025d service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:13:58.440037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dfcf1-fa09-4ace-bcfd-82950dbe025d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:13:58.449500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dfcf1-fa09-4ace-bcfd-82950dbe025d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:13:58.451035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dfcf1-fa09-4ace-bcfd-82950dbe025d service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:13:58.460318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 731/1470] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:13:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:14:02.253299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c21a4-04f8-44ab-855e-1cef51e1c238 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:02.253861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c21a4-04f8-44ab-855e-1cef51e1c238 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:02.253861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747c21a4-04f8-44ab-855e-1cef51e1c238 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:02.255739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 740/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 05:14:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:14:02.261455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563522e-06e2-4f7b-a1b2-3f5ee2778479 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:02.261874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563522e-06e2-4f7b-a1b2-3f5ee2778479 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:02.262017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563522e-06e2-4f7b-a1b2-3f5ee2778479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:02.280189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1563522e-06e2-4f7b-a1b2-3f5ee2778479 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:14:02.281390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1563522e-06e2-4f7b-a1b2-3f5ee2778479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:14:02.289128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 732/1472] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 05:14:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:14:02.341761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c21a4-04f8-44ab-855e-1cef51e1c238 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:14:02.343480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-747c21a4-04f8-44ab-855e-1cef51e1c238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:14:02.398532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747c21a4-04f8-44ab-855e-1cef51e1c238 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:14:02.402959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dadf5-827e-429b-a9d9-a10242cbfbe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:14:02.403603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dadf5-827e-429b-a9d9-a10242cbfbe8 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:02.403890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dadf5-827e-429b-a9d9-a10242cbfbe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:02.404168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dadf5-827e-429b-a9d9-a10242cbfbe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:02.413376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dadf5-827e-429b-a9d9-a10242cbfbe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:14:02.415388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dadf5-827e-429b-a9d9-a10242cbfbe8 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:14:02.424244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 741/1473] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:14:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:14:04.549845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c946-bd79-4f57-8f1d-defae6d93981 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:04.550323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c946-bd79-4f57-8f1d-defae6d93981 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:04.550417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c946-bd79-4f57-8f1d-defae6d93981 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:04.552187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 733/1474] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 10 05:14:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:14:04.557920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2fae0-88d0-4590-8a7b-4e5f710ee573 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:04.558351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2fae0-88d0-4590-8a7b-4e5f710ee573 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:04.558480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2fae0-88d0-4590-8a7b-4e5f710ee573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:04.576985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-6ed2fae0-88d0-4590-8a7b-4e5f710ee573 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:14:04.578220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6ed2fae0-88d0-4590-8a7b-4e5f710ee573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:14:04.586030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 742/1475] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 10 05:14:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:14:04.637489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02548c0-31c4-4240-a4d6-268030d97ce1 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:04.637795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02548c0-31c4-4240-a4d6-268030d97ce1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:04.638050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02548c0-31c4-4240-a4d6-268030d97ce1 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:04.639829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 734/1476] 10.222.0.16 () {54 vars in 966 bytes} [Tue Aug 10 05:14:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:14:04.645039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc87cc8-d752-4172-8c44-9f890d9dfbca None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:04.645331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc87cc8-d752-4172-8c44-9f890d9dfbca None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:04.645613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc87cc8-d752-4172-8c44-9f890d9dfbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:04.664529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-6cc87cc8-d752-4172-8c44-9f890d9dfbca None None] MFA Rules not processed for user `c0521977aa404994bcb8e6ce0dea4bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:14:04.665705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6cc87cc8-d752-4172-8c44-9f890d9dfbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:14:04.672152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 743/1477] 10.222.0.16 () {58 vars in 1064 bytes} [Tue Aug 10 05:14:04 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:14:04.680003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02548c0-31c4-4240-a4d6-268030d97ce1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:14:04.690605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02548c0-31c4-4240-a4d6-268030d97ce1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:14:04.694122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac1b36-d57e-4d82-9da9-0470b4c9394a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:14:04.694788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac1b36-d57e-4d82-9da9-0470b4c9394a service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:14:04.695068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac1b36-d57e-4d82-9da9-0470b4c9394a service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:14:04.695339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac1b36-d57e-4d82-9da9-0470b4c9394a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:14:04.704959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac1b36-d57e-4d82-9da9-0470b4c9394a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:14:04.706385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac1b36-d57e-4d82-9da9-0470b4c9394a service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:14:04.716396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 735/1478] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:14:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:24.785401 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6d14-6ebf-4f9b-8c81-db1d3d3a13d6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.786048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6d14-6ebf-4f9b-8c81-db1d3d3a13d6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.786048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a6d14-6ebf-4f9b-8c81-db1d3d3a13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.806526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9c2a6d14-6ebf-4f9b-8c81-db1d3d3a13d6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:24.808278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9c2a6d14-6ebf-4f9b-8c81-db1d3d3a13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:24.820496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 744/1479] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:24.836079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5cc7e-a201-4689-8120-51816508dc32 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.836628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5cc7e-a201-4689-8120-51816508dc32 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.836628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5cc7e-a201-4689-8120-51816508dc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.857964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3ef5cc7e-a201-4689-8120-51816508dc32 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:24.859454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3ef5cc7e-a201-4689-8120-51816508dc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:24.867714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.868011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.868280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.875042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 736/1480] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:24.876661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40596-774f-4084-93d8-fb2fcc2d6f9d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.876955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40596-774f-4084-93d8-fb2fcc2d6f9d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.877229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40596-774f-4084-93d8-fb2fcc2d6f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.897180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:24.898399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:24.907884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 745/1481] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:24.908399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-90c40596-774f-4084-93d8-fb2fcc2d6f9d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:24.908705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:24.909584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-90c40596-774f-4084-93d8-fb2fcc2d6f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:24.919150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f6946-8d43-4db4-96e5-516509432b26 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:24.924347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:24.925111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.925398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.925673 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.925955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 737/1482] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:24.926462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:24.926793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:24.927348 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.927668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.927948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.928496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ee4eff-778b-42a8-b736-2dcf35b30a13 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:24.942898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 746/1483] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:24.944352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf1f1-6d62-4576-af1e-28132411d32d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.944647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf1f1-6d62-4576-af1e-28132411d32d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.944919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4cf1f1-6d62-4576-af1e-28132411d32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.963203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3b4cf1f1-6d62-4576-af1e-28132411d32d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:24.964759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:24.964892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3b4cf1f1-6d62-4576-af1e-28132411d32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:24.965940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:24.981372 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 747/1484] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:24.983122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f3975-8290-4ed7-b2d7-fef8d30601ce None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:24.983559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f3975-8290-4ed7-b2d7-fef8d30601ce None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:24.984253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f3975-8290-4ed7-b2d7-fef8d30601ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:24.988151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 738/1485] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:24.988859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:24.999175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596fad5-0a3c-48ec-a26d-8558de5ad45a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.005148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-736f3975-8290-4ed7-b2d7-fef8d30601ce None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.006651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b48a8-6ed5-4ee3-bfd6-67ae89a7f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.006914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-736f3975-8290-4ed7-b2d7-fef8d30601ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.007609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b48a8-6ed5-4ee3-bfd6-67ae89a7f3db admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.007890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b48a8-6ed5-4ee3-bfd6-67ae89a7f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.008163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b48a8-6ed5-4ee3-bfd6-67ae89a7f3db admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.008858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b48a8-6ed5-4ee3-bfd6-67ae89a7f3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.011271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b48a8-6ed5-4ee3-bfd6-67ae89a7f3db admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.017490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 748/1486] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.022441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335d261-c4e3-474d-a4a1-10642ed9089c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.022441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335d261-c4e3-474d-a4a1-10642ed9089c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.022441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335d261-c4e3-474d-a4a1-10642ed9089c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.040137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0335d261-c4e3-474d-a4a1-10642ed9089c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.041266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0335d261-c4e3-474d-a4a1-10642ed9089c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.049461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 749/1487] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.054688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.054688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.054688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.070423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.071751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.079518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 750/1488] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.081294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.089669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc64c-ea13-48ad-9b0d-473184b2745d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.094400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.095080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.095477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.095757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.096474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.096780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.098371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e83b71-5d0d-401a-b828-49b84fc129b2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.109450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 739/1489] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:24 2021] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.110700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 751/1490] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.110898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2005-4b40-4d8e-acf6-b4ea676f6644 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.111198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2005-4b40-4d8e-acf6-b4ea676f6644 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.111476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2005-4b40-4d8e-acf6-b4ea676f6644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.111874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56236261-387e-4a25-a616-27a21c731de5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.112172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56236261-387e-4a25-a616-27a21c731de5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.112452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56236261-387e-4a25-a616-27a21c731de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.131174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-56236261-387e-4a25-a616-27a21c731de5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.132440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-56236261-387e-4a25-a616-27a21c731de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.138691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c9be2005-4b40-4d8e-acf6-b4ea676f6644 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.139858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c9be2005-4b40-4d8e-acf6-b4ea676f6644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.191388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 752/1491] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.192259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56236261-387e-4a25-a616-27a21c731de5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.197630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 740/1492] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.201700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56236261-387e-4a25-a616-27a21c731de5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.202287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e4206-2068-4b12-bfd0-c70c7e86d44e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.202601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e4206-2068-4b12-bfd0-c70c7e86d44e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.202890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e4206-2068-4b12-bfd0-c70c7e86d44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.206563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.207265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.207546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.207819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.208541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.208849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.210458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f79c9-6edd-4c29-953d-441ea8e2c2cf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.220813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-254e4206-2068-4b12-bfd0-c70c7e86d44e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.222017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-254e4206-2068-4b12-bfd0-c70c7e86d44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.234272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 753/1493] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.234272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.234272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.234272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.234718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 741/1494] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.234718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.234718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.234718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.247628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.248818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.250030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.251224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.257225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 754/1495] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.259432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.264562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 742/1496] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.265402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.268043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e6b67-2aa4-44e2-8041-ddf922461a39 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.272659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139dfb8-ba49-4472-824a-8773511ebce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.273364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139dfb8-ba49-4472-824a-8773511ebce5 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.273625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139dfb8-ba49-4472-824a-8773511ebce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.273903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139dfb8-ba49-4472-824a-8773511ebce5 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.274543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f246202-0975-4f73-bfbe-65ac986a61cd None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.274740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139dfb8-ba49-4472-824a-8773511ebce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.277153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139dfb8-ba49-4472-824a-8773511ebce5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.279778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adaa90a-51cf-4e32-b510-7bc6189c90f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.280428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaa90a-51cf-4e32-b510-7bc6189c90f8 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.280712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaa90a-51cf-4e32-b510-7bc6189c90f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.281067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adaa90a-51cf-4e32-b510-7bc6189c90f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.281725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adaa90a-51cf-4e32-b510-7bc6189c90f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.283639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adaa90a-51cf-4e32-b510-7bc6189c90f8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.376512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 755/1497] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.377800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.378089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.378366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.396041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.397281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.405807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 756/1498] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.406567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.415455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee5fe5-4b5a-429e-90e4-7d3c962a3ce1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.420610 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.421236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.421517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.421792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.422528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.422889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.424485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.435519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 757/1499] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.436253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.445391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030345f-a757-4b14-8b39-ea07703d7364 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.450048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.450707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.450990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.451263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.451925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.453771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.524048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 743/1500] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/projects => generated 393 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.525066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.525350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.525624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.544646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:25.545800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:25.589605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 758/1501] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.590606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.605593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 744/1502] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:25.606765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.616250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c58091-4f2c-4c5f-91e0-7245c2422384 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.655691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b08f9-a272-43c8-aaf0-15a4364be850 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.660408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.661068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.661351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.661625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.662349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.662683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.664302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.671001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.671705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.671994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.672268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.672989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.673297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.674906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.676302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 759/1503] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.677114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.687186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cd2055-1906-4068-9891-2902b07b1a70 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.687546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 745/1504] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.688371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.691899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.692554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.692834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.693108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.693821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.695466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.700379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31a546-2def-42f4-b42d-fc7f4079eb98 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.705012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.710635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.710635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.710635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.710920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 760/1505] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:25.711007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.711007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.711162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.711237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.718106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c65bb-89cf-4c0b-99a3-8b54d38dc9e3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.723110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.723386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 746/1506] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.724214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.727171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.727586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.727972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.728779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.732274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.735145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4cf44-d36b-43f6-871d-d8957b0cc82e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.739737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.740392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.740675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.740946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.741625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.743572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.815800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 761/1507] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.816640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.871762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 747/1508] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.872521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.877988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86006886-dd0d-4de5-ac15-9e08c2f19ca8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.882132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497d6db-b625-48aa-bd82-d226104b98ca admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.883728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.884391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.884671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.885009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.885658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.887671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.887809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.888410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.888699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.888977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.889836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:25.890145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.891855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.903867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 748/1509] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:25.908941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.918962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471e960-94a9-4ceb-9ca2-f1ebab12949a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.923673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.924294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.924576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.924851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.925535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.927532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:25.965701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 762/1510] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/users => generated 283 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:25.965701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:25.972705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c75e-0c52-4965-833d-39a662b67ae5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:25.977249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:25.977930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:25.978238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:25.978511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:25.979818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:25.981727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.020698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 749/1511] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/projects => generated 389 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.021524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.083288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38dc06-fcb4-4a37-9ea8-510d82245e1f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.086929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 763/1512] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:25 2021] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.087802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.091819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.092503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.092781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.093050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.093775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.095405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.109302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 750/1513] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.109302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.116128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dbd37-f0aa-4bc7-b477-bed557c97b00 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.148179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198c821-7954-4365-a10f-b1191907f450 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.154079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.154874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.155219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.155555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.156309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.158315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.170731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.171433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.171721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.171998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.172680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.174624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.245838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 764/1514] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.246688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.263928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 751/1515] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.263928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.273813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5b012-0627-472b-a0c8-cbeebddf0366 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.307761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acf5b9-d7f8-4a22-a38e-dfb9618af319 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.312486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.313147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.313427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.313754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.314468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.316085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.326150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 765/1516] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.327104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.329956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.330648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.330956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.331229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.331938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.333863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.336185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d1f5f4-ed6e-4978-871a-b348b235028d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.341264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.341889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.342170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.342735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.343164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.344705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.354345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 766/1517] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.355319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.364848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d86ed-2c9b-41d6-b331-2d3e115bf725 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.369462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.370129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.370407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.370750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.371421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.373331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.444075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 752/1518] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/projects => generated 363 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.444840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.467101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 767/1519] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.467962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.477885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5a580-9ab7-48fd-b437-d0edbef34801 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.514159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c75c0-81ba-47c0-af05-1773745b1ba9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.520388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.520388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.520388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.520388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.521022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.523006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.533216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.534161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.534531 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.534734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] PATH_INFO: `/v3/projects/72a3bb25c2374aa8a148b26d66d2eda1/users/490a8522f743475187844c39a4ba6dea/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.548650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a3bb25c2374aa8a148b26d66d2eda1, user_id=490a8522f743475187844c39a4ba6dea, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.551349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.631489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 753/1520] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.632433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.643214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f7711-a813-4334-aa19-101431e36667 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.648032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.648680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.648965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.649240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.649916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.652457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.660016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 768/1521] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:26 2021] PUT /identity/v3/projects/72a3bb25c2374aa8a148b26d66d2eda1/users/490a8522f743475187844c39a4ba6dea/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:26.660904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.721873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e61e65-4f64-43d8-bc3c-d8292f6c98fa admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.726526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.727209 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.727490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.727763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.728485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.730701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.740363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 769/1522] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.741271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.748398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 754/1523] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/users => generated 303 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.750462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.751427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72791b-e810-419d-94cb-4e7b625264fb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.756232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.756884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.757164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.757440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.758198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.759815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.762065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2982ee-3faa-4115-b538-e823f364c095 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.766708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.767366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.767656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.767936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.768659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.769833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 770/1524] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.770753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.773352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.780447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f21287-fded-4583-9a4e-443e2207e1cf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.787489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 755/1525] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.787489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.787738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.787738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.787738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.787738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.788107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.789015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.797635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d922b6-89ae-4b16-9053-ff296acda999 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.802354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.803032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.803317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.803590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.804294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.805889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.815525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 756/1526] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.816296 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.825416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4b04f-7784-4d51-bcad-508ac3ca171d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.830010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96c830-1f52-457c-a890-b89984d37611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.830664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c830-1f52-457c-a890-b89984d37611 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.830924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c830-1f52-457c-a890-b89984d37611 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.831201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96c830-1f52-457c-a890-b89984d37611 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.831899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c830-1f52-457c-a890-b89984d37611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.833412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96c830-1f52-457c-a890-b89984d37611 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.843232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 757/1527] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.844380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.844669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.844951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.863319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 771/1528] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/users => generated 282 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:26.863319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.863911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:26.863911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:26.871245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfdfff5-8d97-4e88-af05-449516cbb6e0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.871928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 758/1529] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:26.872707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.876107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.876776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.877061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.877336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.878191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.879869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.882210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e01a3e-9bf8-444a-9642-bc437f7b9777 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.887089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.887746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.888029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.888306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.889020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.890638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.890759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 772/1530] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.891432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.901539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a00a88-91fd-492f-b51e-f12fde8da899 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.905236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 759/1531] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:26.905236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:26.909292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.910168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.910450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.910765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] PATH_INFO: `/v3/projects/ec44caf79c6e4d48a3d328a58919df19/users/a561148ea4c14d07a050ca8dc5787085/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.914368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e1536-f595-4bc7-934b-b6663b162dd0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:26.919807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:26.920817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:26.921104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:26.921381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] PATH_INFO: `/v3/projects/ec9415291d76428aa315e688bd98ef88/users/a6d0c7ce2305400397adf12369141f39/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:26.925613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec44caf79c6e4d48a3d328a58919df19, user_id=a561148ea4c14d07a050ca8dc5787085, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.928361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:26.935330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec9415291d76428aa315e688bd98ef88, user_id=a6d0c7ce2305400397adf12369141f39, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:26.937979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.025511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 773/1532] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:26 2021] PUT /identity/v3/projects/ec44caf79c6e4d48a3d328a58919df19/users/a561148ea4c14d07a050ca8dc5787085/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.027015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.056201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 760/1533] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:26 2021] PUT /identity/v3/projects/ec9415291d76428aa315e688bd98ef88/users/a6d0c7ce2305400397adf12369141f39/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.057230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.086867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e63cd9-7ea3-4772-a439-5f57fce4475f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.115922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a576bab-0e9f-44d7-8cc2-2f6565862de6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.120498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.121161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.121437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.121727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.122424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.124040 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.133392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 761/1534] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:27.134143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.143135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.143588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb56ef4-564c-48b0-9163-29020f9d9296 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.143807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.144094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.144370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.145115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.146769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.148166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.148791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.149070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.149344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.150035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.152482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.159996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 774/1535] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:27.159996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.164544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 762/1536] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:27.164544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.172246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ddc03-7209-43f0-b4a5-ae2eab25d209 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.176757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.177604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.177886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.178158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] PATH_INFO: `/v3/projects/0d6a6362fb394ea19663961e192d435f/users/c3bc338eac9c467bacba780d17a6680c/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.192665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6a6362fb394ea19663961e192d435f, user_id=c3bc338eac9c467bacba780d17a6680c, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.195339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.212138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca849bd-90d8-494d-91c0-c26f7ef90833 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.215998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.216691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.217028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.217309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.226122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.227697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.237877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 775/1537] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:27.238804 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.248178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d6a98-4c0b-4370-923b-43c2570ab684 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.252924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb65715-eb94-47ec-8c75-7447d54e0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.253567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65715-eb94-47ec-8c75-7447d54e0d7a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.253850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65715-eb94-47ec-8c75-7447d54e0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.254127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb65715-eb94-47ec-8c75-7447d54e0d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.255074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65715-eb94-47ec-8c75-7447d54e0d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.256664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb65715-eb94-47ec-8c75-7447d54e0d7a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.266587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 776/1538] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:27.267947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154defac-b795-403f-9a41-b7fb81362366 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.268241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154defac-b795-403f-9a41-b7fb81362366 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.268520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154defac-b795-403f-9a41-b7fb81362366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.287825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-154defac-b795-403f-9a41-b7fb81362366 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:27.289040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-154defac-b795-403f-9a41-b7fb81362366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:27.297271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 777/1539] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:27.298596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.298900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.299176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.308667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 763/1540] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:27 2021] PUT /identity/v3/projects/0d6a6362fb394ea19663961e192d435f/users/c3bc338eac9c467bacba780d17a6680c/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.309559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.326824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] MFA Rules not processed for user `a6d0c7ce2305400397adf12369141f39`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:27.328047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:27.375884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4ef1a-ead7-4cfb-a0de-b4b6a181ab66 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.382307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.383251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.383533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.383811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] PATH_INFO: `/v3/projects/9418eeb2771342b99e046a1b5d9a1ea5/users/d54df4b83622480cb64cca23a5b65eda/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.394874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 778/1541] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:27.395546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.399865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9418eeb2771342b99e046a1b5d9a1ea5, user_id=d54df4b83622480cb64cca23a5b65eda, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.402646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.406188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ad9b6-0ba7-414d-955d-b034f0e7a8ab None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.410975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.413013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.413013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.413013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] PATH_INFO: `/v3/projects/1bebe35ab6ed44b49537caff8aaa8562/users/af5ad45d471648a487e5c95cb63163e8/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.428172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bebe35ab6ed44b49537caff8aaa8562, user_id=af5ad45d471648a487e5c95cb63163e8, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.431127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.488829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 764/1542] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:27 2021] PUT /identity/v3/projects/9418eeb2771342b99e046a1b5d9a1ea5/users/d54df4b83622480cb64cca23a5b65eda/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.493468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.518166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 779/1543] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:27 2021] PUT /identity/v3/projects/1bebe35ab6ed44b49537caff8aaa8562/users/af5ad45d471648a487e5c95cb63163e8/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.518166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.549978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f99d0b-90b8-4a3a-9d9d-092ddd6565f9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.581078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b05ab-f71c-48df-ad1f-84853974cb27 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.586081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597e59c-fbaf-4fd3-879c-ecbe72ac2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.587084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e59c-fbaf-4fd3-879c-ecbe72ac2a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.587366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e59c-fbaf-4fd3-879c-ecbe72ac2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.587775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597e59c-fbaf-4fd3-879c-ecbe72ac2a76 admin admin] PATH_INFO: `/v3/projects/f914c8ce34d5428ab7529ff358ada4e4/users/c0cf87313ac9406e9f07217a4c685361/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.603551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e59c-fbaf-4fd3-879c-ecbe72ac2a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f914c8ce34d5428ab7529ff358ada4e4, user_id=c0cf87313ac9406e9f07217a4c685361, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.605848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.606361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.606685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.606967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.607218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597e59c-fbaf-4fd3-879c-ecbe72ac2a76 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.607792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.609686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.619648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 765/1544] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:27.620960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.679487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5fa812-d025-44e1-820e-f2472c87a49f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.683815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 780/1545] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:27 2021] PUT /identity/v3/projects/f914c8ce34d5428ab7529ff358ada4e4/users/c0cf87313ac9406e9f07217a4c685361/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.685120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.685413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.687150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.712679 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] MFA Rules not processed for user `c3bc338eac9c467bacba780d17a6680c`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:27.714748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:27.728684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74975a2d-a4c1-41c4-8848-5b5d3de5d117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.729367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975a2d-a4c1-41c4-8848-5b5d3de5d117 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.729655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975a2d-a4c1-41c4-8848-5b5d3de5d117 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.729933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975a2d-a4c1-41c4-8848-5b5d3de5d117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.777587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 781/1546] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:27.778489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.797852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74975a2d-a4c1-41c4-8848-5b5d3de5d117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.799334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74975a2d-a4c1-41c4-8848-5b5d3de5d117 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.810559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 766/1547] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:27.811933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dc63-f6d0-4558-a7e2-63636ecb50e4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.812288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dc63-f6d0-4558-a7e2-63636ecb50e4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.812633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8dc63-f6d0-4558-a7e2-63636ecb50e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.830963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-47e8dc63-f6d0-4558-a7e2-63636ecb50e4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:27.832206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-47e8dc63-f6d0-4558-a7e2-63636ecb50e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:27.840124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 767/1548] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:27.841442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.841736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.842012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.847682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e64cfe-1f64-4756-bd7d-a077c4b79029 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.853148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7cf0a-563f-46c4-8980-9518afcc63eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.853865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7cf0a-563f-46c4-8980-9518afcc63eb admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.855046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7cf0a-563f-46c4-8980-9518afcc63eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.855046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7cf0a-563f-46c4-8980-9518afcc63eb admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.855739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7cf0a-563f-46c4-8980-9518afcc63eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.858081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e7cf0a-563f-46c4-8980-9518afcc63eb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.860718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:27.861932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:27.870481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 768/1549] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:27.873771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:27.882811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba3a82-81d4-44a0-b24d-39318962a753 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:27.888513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75feb5f-5489-40e1-82eb-bc6b92c52587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:27.889406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75feb5f-5489-40e1-82eb-bc6b92c52587 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.889693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75feb5f-5489-40e1-82eb-bc6b92c52587 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.889972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75feb5f-5489-40e1-82eb-bc6b92c52587 admin admin] PATH_INFO: `/v3/projects/58a8973d66db4cf5914e95b4a1a90573/users/ab616126f3fb408eabf08ef7e6d36041/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.905696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75feb5f-5489-40e1-82eb-bc6b92c52587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58a8973d66db4cf5914e95b4a1a90573, user_id=ab616126f3fb408eabf08ef7e6d36041, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:27.908527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75feb5f-5489-40e1-82eb-bc6b92c52587 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:27.964165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 782/1550] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:27.965585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.965947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.966294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.997091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] MFA Rules not processed for user `c0cf87313ac9406e9f07217a4c685361`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:27.997224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 769/1551] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:27 2021] PUT /identity/v3/projects/58a8973d66db4cf5914e95b4a1a90573/users/ab616126f3fb408eabf08ef7e6d36041/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:27.997766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e88cc-6ec1-45df-bac1-0e4fb66a0153 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:27.998190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e88cc-6ec1-45df-bac1-0e4fb66a0153 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:27.998634 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e88cc-6ec1-45df-bac1-0e4fb66a0153 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:27.999060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:28.000587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 770/1552] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 10 05:15:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:15:28.001485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e88cc-6ec1-45df-bac1-0e4fb66a0153 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.064649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e88cc-6ec1-45df-bac1-0e4fb66a0153 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.068760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.069373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 783/1553] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:27 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:28.069849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.070381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.070767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.073598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.083038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e5208-3685-4a79-b2f2-dab6f9eaa368 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.087496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1baacc-5c81-47a2-92ae-da9cacc3b333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.091514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baacc-5c81-47a2-92ae-da9cacc3b333 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.091514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baacc-5c81-47a2-92ae-da9cacc3b333 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.091514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1baacc-5c81-47a2-92ae-da9cacc3b333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.158767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.160369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.171356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 771/1554] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:28.172139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.181715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f286fd6-e616-4a3a-99d1-3b0e9fd8d4fa service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.184167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baacc-5c81-47a2-92ae-da9cacc3b333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.188916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1baacc-5c81-47a2-92ae-da9cacc3b333 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.189045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.189375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.189662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.189939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.190669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.193055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.197648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 784/1555] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:28.199031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b8b5d-b9b6-4dca-b27a-827191253423 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.199322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b8b5d-b9b6-4dca-b27a-827191253423 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.199594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b8b5d-b9b6-4dca-b27a-827191253423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.217992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-637b8b5d-b9b6-4dca-b27a-827191253423 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:28.219815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-637b8b5d-b9b6-4dca-b27a-827191253423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:28.284061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 785/1556] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:28.285510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.286040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.286181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.313593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] MFA Rules not processed for user `ab616126f3fb408eabf08ef7e6d36041`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:28.314983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:28.360868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 772/1557] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:28.361778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.373429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9c2d3-083c-4cb0-a75b-28522d340693 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.378181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.378884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.379172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.379470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.380152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.382197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.384493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 786/1558] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:28.385928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.403049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cdf03e-cf8b-40fe-b0bc-61bffe9e0d0e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.408803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.409454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.409740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.410048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.463093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.465207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.473878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 787/1559] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:28 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:28.474778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.485596 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f1636f-55e3-4263-b76f-48695dfd8f29 service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.491044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.491730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.492099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.492378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.493234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.495019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.503119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 773/1560] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:28.509494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 788/1561] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:28.509656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.513097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.529433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f22bf-8535-4bcb-861a-780807ca4d9e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.617842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62b1a3-2f05-4db7-a24e-eba36862744d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.623400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.624521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.624913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.625335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.626310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.628453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.634877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.636104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.636393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.637295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.638055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.640957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.736122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 774/1562] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:28.736122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.795730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 789/1563] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/users => generated 308 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:28.797241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.809331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56f5b0-1324-45ee-80aa-037a9eeb7f72 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.814159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fc1de-9617-4e9d-8f25-ec7f496053a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.814854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc1de-9617-4e9d-8f25-ec7f496053a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.815146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc1de-9617-4e9d-8f25-ec7f496053a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.815410 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fc1de-9617-4e9d-8f25-ec7f496053a6 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.816092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc1de-9617-4e9d-8f25-ec7f496053a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.816624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99668a24-094b-4dee-93c6-35d0b37d9bff admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:28.818092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fc1de-9617-4e9d-8f25-ec7f496053a6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.821324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:28.822208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.822499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.822821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] PATH_INFO: `/v3/projects/ba32d1c097134ab4b8aaf4b36b6ed69a/users/656738b4f5e34cf2828e2bcf78206381/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.836914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba32d1c097134ab4b8aaf4b36b6ed69a, user_id=656738b4f5e34cf2828e2bcf78206381, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:28.839623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:28.922058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 790/1564] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:28 2021] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:28.922058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ed22-fb3a-4910-8987-4a5018dd282a None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:28.922058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ed22-fb3a-4910-8987-4a5018dd282a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:28.922058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549ed22-fb3a-4910-8987-4a5018dd282a None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:28.923562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 775/1565] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:28 2021] PUT /identity/v3/projects/ba32d1c097134ab4b8aaf4b36b6ed69a/users/656738b4f5e34cf2828e2bcf78206381/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:28.924003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.926465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 791/1566] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 10 05:15:28 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:15:28.927306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ed22-fb3a-4910-8987-4a5018dd282a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:28.995928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549ed22-fb3a-4910-8987-4a5018dd282a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.001550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.002255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.002543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.002850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.004280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.006006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.011944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270793f-ec14-40b2-9feb-0b91d85742e9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.019533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 792/1567] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:29.019691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9be96-310d-4983-bca5-8b6847cef6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.019795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.019910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9be96-310d-4983-bca5-8b6847cef6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.019910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9be96-310d-4983-bca5-8b6847cef6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.019910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9be96-310d-4983-bca5-8b6847cef6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.019910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9be96-310d-4983-bca5-8b6847cef6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.020859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9be96-310d-4983-bca5-8b6847cef6b4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.028084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f6847-2914-4a2e-a620-3d1d6b880fc8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.033795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 776/1568] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:28 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:29.036883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.036883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.036883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.037134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.037134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.037134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.037134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.037442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.039345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.057631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:29.059195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 793/1569] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:29 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:29.060226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.062697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:29.072459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b11f-4c81-429d-b031-6b9c4093ced4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.078155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.085847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.085847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.085847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] PATH_INFO: `/v3/projects/dbf89868d98e466185986dda950fe549/users/718f9d67ebfe4ee782ca4a643d8a6ee1/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.097157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf89868d98e466185986dda950fe549, user_id=718f9d67ebfe4ee782ca4a643d8a6ee1, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.100133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.133949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 777/1570] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:15:29 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:29.134954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.145218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029c04c-6caa-44e9-b89f-0d66c86afa6a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.149899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.151301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.151594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.151872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] PATH_INFO: `/v3/projects/6678a0cb329c4a1d8eefc7ed239e18ed/users/15ed8a128bf044878b1cfe8789b4f269/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.165803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] RBAC: Authorizing `identity:create_grant(project_id=6678a0cb329c4a1d8eefc7ed239e18ed, user_id=15ed8a128bf044878b1cfe8789b4f269, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.169200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.256751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 778/1571] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:29 2021] PUT /identity/v3/projects/6678a0cb329c4a1d8eefc7ed239e18ed/users/15ed8a128bf044878b1cfe8789b4f269/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:29.257875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.262316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 794/1572] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:29 2021] PUT /identity/v3/projects/dbf89868d98e466185986dda950fe549/users/718f9d67ebfe4ee782ca4a643d8a6ee1/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:29.262316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.324949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec5112-2de2-4c79-a881-c88de97bf428 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.328745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.329799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.330088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.330354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.348375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ff775-2cc6-4833-986c-96b7ab2ddcae admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.407950 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.409408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.413540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.414446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.414763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.415235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] PATH_INFO: `/v3/projects/ba32d1c097134ab4b8aaf4b36b6ed69a/users/656738b4f5e34cf2828e2bcf78206381/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.418158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba32d1c097134ab4b8aaf4b36b6ed69a, user_id=656738b4f5e34cf2828e2bcf78206381, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.420946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.423244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 795/1573] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:29.424092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.441845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 779/1574] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:29 2021] PUT /identity/v3/projects/ba32d1c097134ab4b8aaf4b36b6ed69a/users/656738b4f5e34cf2828e2bcf78206381/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:29.441845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.446314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4751243-08f3-4926-866b-8e4fd04ebf45 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.515955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f38fac-d9e1-4e3e-87a1-49df200960a7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.517534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856e09f-40c3-467c-afe3-bd924cf5da66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.518290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856e09f-40c3-467c-afe3-bd924cf5da66 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.518688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856e09f-40c3-467c-afe3-bd924cf5da66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.519029 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856e09f-40c3-467c-afe3-bd924cf5da66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.520048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856e09f-40c3-467c-afe3-bd924cf5da66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.521771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0856e09f-40c3-467c-afe3-bd924cf5da66 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.528017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.529711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.530124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.530500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.531290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.533540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.536208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 796/1575] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:29 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:29.537534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076ca1-1381-4c32-b7d3-2f8ef121a140 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.537822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076ca1-1381-4c32-b7d3-2f8ef121a140 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.538099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a076ca1-1381-4c32-b7d3-2f8ef121a140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.552643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 780/1576] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:29 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:29.553661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.566282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6227e-87f6-49e2-8a45-7933259fc11b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.571498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.573364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.573652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.573945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] PATH_INFO: `/v3/projects/6678a0cb329c4a1d8eefc7ed239e18ed/users/15ed8a128bf044878b1cfe8789b4f269/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.575999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6678a0cb329c4a1d8eefc7ed239e18ed, user_id=15ed8a128bf044878b1cfe8789b4f269, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.578715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.579788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3a076ca1-1381-4c32-b7d3-2f8ef121a140 None None] MFA Rules not processed for user `656738b4f5e34cf2828e2bcf78206381`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:29.581270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3a076ca1-1381-4c32-b7d3-2f8ef121a140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:29.601422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 781/1577] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:29 2021] PUT /identity/v3/projects/6678a0cb329c4a1d8eefc7ed239e18ed/users/15ed8a128bf044878b1cfe8789b4f269/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:29.601422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.687253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 797/1578] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:29 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:29.694709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5a82e-565b-4e4d-b4d6-844222743dce None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.696051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5a82e-565b-4e4d-b4d6-844222743dce None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.698367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5a82e-565b-4e4d-b4d6-844222743dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.723438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a922f5dd-bc19-452f-a63b-5a578802c3e4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.730380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.731512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.731861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.732207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] PATH_INFO: `/v3/projects/dbf89868d98e466185986dda950fe549/users/718f9d67ebfe4ee782ca4a643d8a6ee1/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.735186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf89868d98e466185986dda950fe549, user_id=718f9d67ebfe4ee782ca4a643d8a6ee1, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.738689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:29.761987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 782/1579] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:29 2021] PUT /identity/v3/projects/dbf89868d98e466185986dda950fe549/users/718f9d67ebfe4ee782ca4a643d8a6ee1/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:29.763086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:29.784647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8bb5a82e-565b-4e4d-b4d6-844222743dce None None] MFA Rules not processed for user `15ed8a128bf044878b1cfe8789b4f269`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:29.786374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8bb5a82e-565b-4e4d-b4d6-844222743dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:29.869668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0aa2d6-95ad-4b4d-9d4b-30960b721a09 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:29.877018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:29.880427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.880750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.881030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.921314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 798/1580] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:29 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:29.922802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:29.922802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:29.923044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:29.953071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] MFA Rules not processed for user `718f9d67ebfe4ee782ca4a643d8a6ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:29.954292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:29.972824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:29.974597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:30.000906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 783/1581] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:29 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:30.038612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 799/1582] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:29 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:30.183698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:30.194504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90117fb7-6709-4bb4-a968-7c866dc9cd21 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:30.199812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:30.203982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:30.203982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:30.203982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:30.211615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:30.212832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:30.225308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 784/1583] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:30 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:30.317558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:30.328586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc232f-d283-400b-ae32-40a2b4d4ade0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:30.342534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882f082-c063-4cf0-9c66-aad7c01b245b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:30.343221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882f082-c063-4cf0-9c66-aad7c01b245b service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:30.343512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882f082-c063-4cf0-9c66-aad7c01b245b service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:30.343789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882f082-c063-4cf0-9c66-aad7c01b245b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:30.353761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882f082-c063-4cf0-9c66-aad7c01b245b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:30.355948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882f082-c063-4cf0-9c66-aad7c01b245b service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:30.378642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 800/1584] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:30 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:30.497966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:30.526900 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c33f0c-7089-4954-bc84-85a342f8fe45 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:30.540599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:30.541367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:30.542406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:30.542797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:30.659475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:30.661622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:30.693558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 785/1585] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:30 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:30.791131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff86a-0b67-40eb-9542-782e74b93a3b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:30.791488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff86a-0b67-40eb-9542-782e74b93a3b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:30.802798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ff86a-0b67-40eb-9542-782e74b93a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:30.852504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3b3ff86a-0b67-40eb-9542-782e74b93a3b None None] MFA Rules not processed for user `d54df4b83622480cb64cca23a5b65eda`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:30.856084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3b3ff86a-0b67-40eb-9542-782e74b93a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:30.896448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:30.909261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9a5ab-c903-4f48-af7b-d42b51f8ba44 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:30.919866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:30.920974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:30.921361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:30.922904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.022319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 801/1586] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:30 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:31.035599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5223-e945-489e-bf3c-e379436fd67b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.035599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5223-e945-489e-bf3c-e379436fd67b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.035599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce5223-e945-489e-bf3c-e379436fd67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.059159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:31.060782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:31.075208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-95ce5223-e945-489e-bf3c-e379436fd67b None None] MFA Rules not processed for user `d54df4b83622480cb64cca23a5b65eda`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:31.077590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-95ce5223-e945-489e-bf3c-e379436fd67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:31.082237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 786/1587] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:30 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:31.100505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 802/1588] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:31 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:31.112731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:31.253159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43bd9a-3b83-4ab2-acce-8d5a4b48fca0 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:31.254635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc6c9d-6333-4fd6-be2f-92934a2aa2c6 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.255471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc6c9d-6333-4fd6-be2f-92934a2aa2c6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.255471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc6c9d-6333-4fd6-be2f-92934a2aa2c6 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.257306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 803/1589] 10.222.0.16 () {54 vars in 961 bytes} [Tue Aug 10 05:15:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:15:31.264212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec5e3-3370-4509-a613-cafb4bc36dcb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.264212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec5e3-3370-4509-a613-cafb4bc36dcb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.264212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bec5e3-3370-4509-a613-cafb4bc36dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.266081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400778-bd77-448a-994d-e070bc37f1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:31.266755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400778-bd77-448a-994d-e070bc37f1de service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.267047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400778-bd77-448a-994d-e070bc37f1de service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.267327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400778-bd77-448a-994d-e070bc37f1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.280901 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400778-bd77-448a-994d-e070bc37f1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:31.282525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400778-bd77-448a-994d-e070bc37f1de service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:31.295290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 787/1590] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:31 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:31.300002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-37bec5e3-3370-4509-a613-cafb4bc36dcb None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:31.301414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-37bec5e3-3370-4509-a613-cafb4bc36dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:31.318902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 804/1591] 10.222.0.16 () {58 vars in 1059 bytes} [Tue Aug 10 05:15:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:31.322447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e643ec-c15c-4802-98ec-7ffe4849903b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.322447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e643ec-c15c-4802-98ec-7ffe4849903b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.322755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e643ec-c15c-4802-98ec-7ffe4849903b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.324996 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 788/1592] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 10 05:15:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:15:31.332376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.332376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.332721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.369050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:31.371505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:31.392564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 805/1593] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:15:31 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:31.758608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e643ec-c15c-4802-98ec-7ffe4849903b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:31.773253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e643ec-c15c-4802-98ec-7ffe4849903b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:31.786257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99649d81-c41d-44f5-836c-7d6695893d8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:31.787284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649d81-c41d-44f5-836c-7d6695893d8c service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.787594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649d81-c41d-44f5-836c-7d6695893d8c service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.787984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99649d81-c41d-44f5-836c-7d6695893d8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.799521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:31.817067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649d81-c41d-44f5-836c-7d6695893d8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:31.818680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99649d81-c41d-44f5-836c-7d6695893d8c service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:31.840277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 789/1594] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:31.874071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c66931-a855-4caf-b618-cf09fe12b38b None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.874484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c66931-a855-4caf-b618-cf09fe12b38b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.874888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c66931-a855-4caf-b618-cf09fe12b38b None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.877070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 790/1595] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 10 05:15:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:15:31.883627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.884110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.884486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.929388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83928-bdf7-419d-b3fb-f2cf5d3df750 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:31.939261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:31.941379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:31.941667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:31.944874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] PATH_INFO: `/v3/users/c0cf87313ac9406e9f07217a4c685361` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:31.949731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0cf87313ac9406e9f07217a4c685361)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:31.950801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: WARNING py.warnings [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:15:31.950801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: warnings.warn(msg) Aug 10 05:15:31.950801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: Aug 10 05:15:31.955069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:31.969877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:31.971468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:32.093017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 791/1596] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:15:31 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:32.145301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:32.156045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a95bd23-02ee-4c72-b395-79bb82cb110a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:32.161220 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8cc9a-6fbf-45fd-9461-664baa992dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:32.161903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cc9a-6fbf-45fd-9461-664baa992dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:32.162306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cc9a-6fbf-45fd-9461-664baa992dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:32.162677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8cc9a-6fbf-45fd-9461-664baa992dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:32.172453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8cc9a-6fbf-45fd-9461-664baa992dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:32.173921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8cc9a-6fbf-45fd-9461-664baa992dc3 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:32.184104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 792/1597] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:32 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:32.304565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0cf87313ac9406e9f07217a4c685361'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:32.357259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0cf87313ac9406e9f07217a4c685361'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:32.388315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0cf87313ac9406e9f07217a4c685361'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:32.454552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0cf87313ac9406e9f07217a4c685361'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:32.455368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0cf87313ac9406e9f07217a4c685361'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:32.463053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 806/1598] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:31 2021] DELETE /identity/v3/users/c0cf87313ac9406e9f07217a4c685361 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:32.468592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:32.469105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:32.469388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:32.499902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:32.501862 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:32.577700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 793/1599] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:32.597287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:32.599295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:32.756265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3309ae0-e10a-4aaf-8106-1edfe19eeb64 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:32.770005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63f80a-270d-4dc0-b659-5624bd440bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:32.770764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f80a-270d-4dc0-b659-5624bd440bed service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:32.771049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f80a-270d-4dc0-b659-5624bd440bed service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:32.771900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63f80a-270d-4dc0-b659-5624bd440bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:32.796140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f80a-270d-4dc0-b659-5624bd440bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:32.804071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af63f80a-270d-4dc0-b659-5624bd440bed service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:32.827194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 807/1600] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:33.212679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:33.215064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:33.382708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c56a6-7b6e-4548-9fde-b47603eb8625 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:33.389675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:33.390851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:33.391342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:33.391927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:33.394083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:33.412627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:33.414765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc690d1a-1ad8-4a13-a345-2ece3048ec73 service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:33.427084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 794/1601] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:33.852521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9091f-70c3-4765-8ac4-110b63353383 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:33.853224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9091f-70c3-4765-8ac4-110b63353383 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:33.853690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9091f-70c3-4765-8ac4-110b63353383 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:33.856812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 808/1602] 10.222.0.16 () {54 vars in 960 bytes} [Tue Aug 10 05:15:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:15:33.864297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:33.864610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:33.864865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:33.888453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] MFA Rules not processed for user `bb96e345c35042f89d5bc2c671113655`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:33.890036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:33.900333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 795/1603] 10.222.0.16 () {58 vars in 1058 bytes} [Tue Aug 10 05:15:33 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:33.913684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9091f-70c3-4765-8ac4-110b63353383 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:33.940740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9091f-70c3-4765-8ac4-110b63353383 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:33.950851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:33.953155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:33.953819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:33.954249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:33.959586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:33.999600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:34.005287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:34.066104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 809/1604] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:35.546208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:35.548153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:35.599056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abdb2b-61bb-4a4c-97b1-f7c23806d833 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:35.622389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:35.622389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:35.622389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:35.622389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] PATH_INFO: `/v3/projects/f914c8ce34d5428ab7529ff358ada4e4` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:35.625935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f914c8ce34d5428ab7529ff358ada4e4)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:35.633878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: WARNING py.warnings [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 10 05:15:35.633878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: warnings.warn(msg) Aug 10 05:15:35.633878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: Aug 10 05:15:35.639007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:35.891160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f914c8ce34d5428ab7529ff358ada4e4', 'request_id': 'req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:35.936763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f914c8ce34d5428ab7529ff358ada4e4', 'request_id': 'req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.045208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f914c8ce34d5428ab7529ff358ada4e4', 'request_id': 'req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.061601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] The token cache is being invalidate because project f914c8ce34d5428ab7529ff358ada4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:36.062920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.064308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.068336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 796/1605] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:35 2021] DELETE /identity/v3/projects/f914c8ce34d5428ab7529ff358ada4e4 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:36.072388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:36.093869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06018b-e39c-42ce-a7a0-84e24012b9ca service placement] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:36.122879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:36.124755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:36.280050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:36.283992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:36.283992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:36.283992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] PATH_INFO: `/v3/users/15ed8a128bf044878b1cfe8789b4f269` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:36.283992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ed8a128bf044878b1cfe8789b4f269)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:36.302520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:36.320288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddb785-fc51-4c7c-8fa1-b3f793f726e4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:36.326283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:36.327425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:36.327745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:36.328024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] PATH_INFO: `/v3/users/ab616126f3fb408eabf08ef7e6d36041` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:36.329429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab616126f3fb408eabf08ef7e6d36041)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:36.331414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:36.539394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab616126f3fb408eabf08ef7e6d36041'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.562205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab616126f3fb408eabf08ef7e6d36041'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.573785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ed8a128bf044878b1cfe8789b4f269'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.605837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ed8a128bf044878b1cfe8789b4f269'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.615990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ed8a128bf044878b1cfe8789b4f269'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.636010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab616126f3fb408eabf08ef7e6d36041'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.645409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab616126f3fb408eabf08ef7e6d36041'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.646770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2e3f2da4-a0af-4e1d-97b2-884ca529a126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab616126f3fb408eabf08ef7e6d36041'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.655294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 797/1606] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:36 2021] DELETE /identity/v3/users/ab616126f3fb408eabf08ef7e6d36041 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:36.660908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:36.661817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:36.662386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:36.719525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:36.737063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:36.742773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ed8a128bf044878b1cfe8789b4f269'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.743707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ed8a128bf044878b1cfe8789b4f269'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:36.759527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 810/1607] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:36 2021] DELETE /identity/v3/users/15ed8a128bf044878b1cfe8789b4f269 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:36.858238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 798/1608] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:36.914301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:36.916669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:37.074866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb513c5c-b5bd-4e7b-8b77-bfaf25f04836 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:37.084844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d85e2-6b0c-4915-b95a-428571078ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:37.086040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d85e2-6b0c-4915-b95a-428571078ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:37.086536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d85e2-6b0c-4915-b95a-428571078ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:37.087139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d85e2-6b0c-4915-b95a-428571078ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:37.178477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d85e2-6b0c-4915-b95a-428571078ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:37.184205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d85e2-6b0c-4915-b95a-428571078ec2 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:37.222966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 811/1609] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:37.415823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:37.419046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:37.437911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab08cb-6e69-4354-809a-bb4ac47dce3a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:37.445595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:37.447060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:37.447504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:37.447971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] PATH_INFO: `/v3/users/a6d0c7ce2305400397adf12369141f39` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:37.449419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6d0c7ce2305400397adf12369141f39)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:37.452981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:37.712633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6d0c7ce2305400397adf12369141f39'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:37.773826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6d0c7ce2305400397adf12369141f39'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:37.804042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677c72-683d-4933-b3a7-7728e88ac2d2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:37.804597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677c72-683d-4933-b3a7-7728e88ac2d2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:37.805826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86677c72-683d-4933-b3a7-7728e88ac2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:37.875854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-86677c72-683d-4933-b3a7-7728e88ac2d2 None None] MFA Rules not processed for user `490a8522f743475187844c39a4ba6dea`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:37.877349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-86677c72-683d-4933-b3a7-7728e88ac2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:37.891516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6d0c7ce2305400397adf12369141f39'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:37.899148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6d0c7ce2305400397adf12369141f39'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:37.900044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6d0c7ce2305400397adf12369141f39'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:37.913615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 799/1610] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:37 2021] DELETE /identity/v3/users/a6d0c7ce2305400397adf12369141f39 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:37.917346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:37.920960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.035273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 812/1611] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:37 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:38.035273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.035273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.035273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.064634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:38.066615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.074197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c82631-4253-4c2f-9954-a1923859aa70 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:38.087414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:38.088223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.089129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.089410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] PATH_INFO: `/v3/projects/6678a0cb329c4a1d8eefc7ed239e18ed` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.091454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 813/1612] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:38.093395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:38.094951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.095129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6678a0cb329c4a1d8eefc7ed239e18ed)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:38.101355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:38.268138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6678a0cb329c4a1d8eefc7ed239e18ed', 'request_id': 'req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:38.272965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd5f67-342c-42a4-a215-60073b41f29b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:38.288498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6678a0cb329c4a1d8eefc7ed239e18ed', 'request_id': 'req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:38.423706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da9c8b-088a-4270-b698-9f6c4948d8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:38.424393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9c8b-088a-4270-b698-9f6c4948d8e4 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.424693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9c8b-088a-4270-b698-9f6c4948d8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.425050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da9c8b-088a-4270-b698-9f6c4948d8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.434820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6678a0cb329c4a1d8eefc7ed239e18ed', 'request_id': 'req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:38.452474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] The token cache is being invalidate because project 6678a0cb329c4a1d8eefc7ed239e18ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:38.459918 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:38.461877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:38.467980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 800/1613] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:37 2021] DELETE /identity/v3/projects/6678a0cb329c4a1d8eefc7ed239e18ed => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:38.472038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:38.481881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.570548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da9c8b-088a-4270-b698-9f6c4948d8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:38.573815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da9c8b-088a-4270-b698-9f6c4948d8e4 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:38.604895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 814/1614] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:38 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:38.610389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.610724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.611009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.642714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52917ff-6c2e-4c8c-b749-81c29cdd2a66 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:38.646704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:38.647741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.648208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.649056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.651330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.670396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:38.676438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.751227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:38.752677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f0af8-2322-4a28-8550-94ff33d944d7 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:38.766336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 801/1615] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:38.788250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 815/1616] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:38.796615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.798347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.798347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.830846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:38.832335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.842782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 802/1617] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:38.847422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:38.862513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:38.866189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:38.870562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f3525-27cd-4858-a86a-1b8260a2fd43 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:38.886470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:38.887184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.887469 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.887777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.888519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:38.888826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:38.890465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907049b8-c61e-4d88-becd-91099c5eaa56 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:38.911065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f07bc-da41-4ef0-b7f2-1b908ddb9cee None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:38.933884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:38.936221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 816/1618] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:38.937413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.937846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.938495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] PATH_INFO: `/v3/projects/58a8973d66db4cf5914e95b4a1a90573` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.944908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:38.946318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:38.946758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:38.954434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58a8973d66db4cf5914e95b4a1a90573)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:38.961924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:38.983840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:38.985086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:39.144890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 817/1619] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:15:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:39.145751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:39.177706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376f44-58c8-46a9-a187-c0d18111ba51 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:39.207043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58a8973d66db4cf5914e95b4a1a90573', 'request_id': 'req-e9e6e879-8297-4462-b146-45e38338b514'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:39.226790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58a8973d66db4cf5914e95b4a1a90573', 'request_id': 'req-e9e6e879-8297-4462-b146-45e38338b514'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:39.335292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:39.355861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:39.355861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:39.355861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:39.355861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:39.355861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:39.586874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58a8973d66db4cf5914e95b4a1a90573', 'request_id': 'req-e9e6e879-8297-4462-b146-45e38338b514'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:39.621875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 818/1620] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:39 2021] POST /identity/v3/projects => generated 373 bytes in 476 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:39.624459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] The token cache is being invalidate because project 58a8973d66db4cf5914e95b4a1a90573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:39.625198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:39.627333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:39.628844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:39.636145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:39.637784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 803/1621] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:38 2021] DELETE /identity/v3/projects/58a8973d66db4cf5914e95b4a1a90573 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:39.638780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:39.646631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:39.680053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6e879-8297-4462-b146-45e38338b514 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:39.769397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5440fc8-1dfd-4a31-907e-b432b4ee7e16 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:39.775715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:39.777152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:39.777471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:39.777757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:39.778385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:39.780766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:39.861375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:39.864161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:39.864473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:39.864740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] PATH_INFO: `/v3/users/718f9d67ebfe4ee782ca4a643d8a6ee1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:39.869112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=718f9d67ebfe4ee782ca4a643d8a6ee1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:39.874980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:39.944959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 819/1622] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:39 2021] POST /identity/v3/users => generated 287 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:15:39.945923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:39.952324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:40.127487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb75d9-295a-4a57-b276-8d35f3e44ccc admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:40.137129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:40.138042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:40.138405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:40.138815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:40.141282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:40.179404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718f9d67ebfe4ee782ca4a643d8a6ee1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:40.205574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718f9d67ebfe4ee782ca4a643d8a6ee1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:40.240463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:40.243118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:40.255438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 820/1623] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:15:39 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:15:40.256985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:40.270380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c85f7-a64f-4275-8d82-855b9e04a69e service swift] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:40.279331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:40.282696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:40.283304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:40.283863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:40.285062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:40.290196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:40.329685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 821/1624] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:40 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:40.349487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:40.368903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718f9d67ebfe4ee782ca4a643d8a6ee1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:40.371511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6163d599-aa8b-4ccd-b973-82d0b46fbdd6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:40.378393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:40.379988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718f9d67ebfe4ee782ca4a643d8a6ee1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:40.380114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:40.380314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:40.380572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718f9d67ebfe4ee782ca4a643d8a6ee1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:40.381243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:40.382501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:40.384778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:40.401696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 804/1625] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:39 2021] DELETE /identity/v3/users/718f9d67ebfe4ee782ca4a643d8a6ee1 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:40.408814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 822/1626] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:40 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:40.418240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:40.420680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:40.603410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035566-6b9e-4213-bb4e-496a9cc27e9a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:40.618138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f7990-1217-43e1-8377-0a5b31521698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:40.619383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f7990-1217-43e1-8377-0a5b31521698 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:40.620217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f7990-1217-43e1-8377-0a5b31521698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:40.620500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f7990-1217-43e1-8377-0a5b31521698 admin admin] PATH_INFO: `/v3/projects/f26824cf066d4b12822dc08e32a27619/users/4ba3c7e0b6314f1aad05dec4a1110c17/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:40.659191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f7990-1217-43e1-8377-0a5b31521698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26824cf066d4b12822dc08e32a27619, user_id=4ba3c7e0b6314f1aad05dec4a1110c17, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:40.662666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f7990-1217-43e1-8377-0a5b31521698 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:40.900960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:40.902936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:40.934206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a02fa5-8ea7-4f5a-b3f5-486485ed13e1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:40.943172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:40.944493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:40.944777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:40.945053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] PATH_INFO: `/v3/users/c3bc338eac9c467bacba780d17a6680c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:40.947454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3bc338eac9c467bacba780d17a6680c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:40.949816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:40.991076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 805/1627] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:40 2021] PUT /identity/v3/projects/f26824cf066d4b12822dc08e32a27619/users/4ba3c7e0b6314f1aad05dec4a1110c17/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:41.045990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:41.046626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:41.047164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:41.119409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] MFA Rules not processed for user `4ba3c7e0b6314f1aad05dec4a1110c17`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:41.122094 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:41.245650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 806/1628] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:41.257876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:41.299636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3bc338eac9c467bacba780d17a6680c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.332669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3bc338eac9c467bacba780d17a6680c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.351052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3bc338eac9c467bacba780d17a6680c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.433221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3bc338eac9c467bacba780d17a6680c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.436482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3bc338eac9c467bacba780d17a6680c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.441290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 823/1629] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:40 2021] DELETE /identity/v3/users/c3bc338eac9c467bacba780d17a6680c => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:41.442139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:41.445431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ab7e0-3b63-4401-a219-2292be8d073f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:41.446122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:41.617234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df818d4-588c-410d-8a60-405a0fbcb911 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:41.622657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:41.623599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:41.623889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:41.624167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] PATH_INFO: `/v3/projects/ec9415291d76428aa315e688bd98ef88` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:41.628215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec9415291d76428aa315e688bd98ef88)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:41.630728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:41.648582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da53e64-2b8e-467b-b495-e575d5fb2673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:41.649819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53e64-2b8e-467b-b495-e575d5fb2673 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:41.650474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53e64-2b8e-467b-b495-e575d5fb2673 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:41.651834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da53e64-2b8e-467b-b495-e575d5fb2673 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:41.724164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53e64-2b8e-467b-b495-e575d5fb2673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:41.724164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da53e64-2b8e-467b-b495-e575d5fb2673 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:41.840330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 807/1630] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:41 2021] POST /identity/v3/projects => generated 373 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:41.852740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:41.853438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:41.854284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:41.857924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec9415291d76428aa315e688bd98ef88', 'request_id': 'req-b0348a50-66b9-447f-8231-387c17e9ca3d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.889040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec9415291d76428aa315e688bd98ef88', 'request_id': 'req-b0348a50-66b9-447f-8231-387c17e9ca3d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:41.928229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:41.929788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:42.201686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec9415291d76428aa315e688bd98ef88', 'request_id': 'req-b0348a50-66b9-447f-8231-387c17e9ca3d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:42.201686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] The token cache is being invalidate because project ec9415291d76428aa315e688bd98ef88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:42.201686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:42.201686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b0348a50-66b9-447f-8231-387c17e9ca3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:42.201686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 824/1631] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:41 2021] DELETE /identity/v3/projects/ec9415291d76428aa315e688bd98ef88 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:42.210242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.210242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.210242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.212718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 808/1632] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:42.212718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:42.212718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:42.213242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:42.213242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:42.213538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a665b-16c7-44d6-8aad-68a0c0bd1aee None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:42.213538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:42.213538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.213538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.214470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.214470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:42.214470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:42.214641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 825/1633] 10.222.0.35 () {58 vars in 1016 bytes} [Tue Aug 10 05:15:42 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:42.214641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:42.214641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:42.232719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd44f2-f689-4470-88d6-8984ef02ed3d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:42.247443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:42.248614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.248943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.249235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] PATH_INFO: `/v3/users/656738b4f5e34cf2828e2bcf78206381` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.255579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656738b4f5e34cf2828e2bcf78206381)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:42.257844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:42.328520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 809/1634] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:42 2021] POST /identity/v3/users => generated 293 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:42.329597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:42.331510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:42.363328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b432b-7992-42d9-9140-c02027be530b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:42.375238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:42.376143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.377863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.378446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.406662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:42.408438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:42.434166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 810/1635] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:42.435276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:42.437187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:42.453067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54672182-a8e3-4917-9558-e32f77c39065 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:42.458855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:42.459724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.471844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.471844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.486490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:42.488340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:42.532241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 811/1636] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:42 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:42.533666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:42.587574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656738b4f5e34cf2828e2bcf78206381'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:42.597933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f732a31-5b80-48d5-83fc-41fbe5edf982 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:42.612999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:42.613628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.613907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.614185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.615019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:42.616755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:42.634283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656738b4f5e34cf2828e2bcf78206381'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:42.642372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 812/1637] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:42 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:42.646204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:42.653557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656738b4f5e34cf2828e2bcf78206381'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:42.669283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360b526-0f60-4e05-987b-9ee471d2dea0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:42.683306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:42.684285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:42.684562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:42.684840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] PATH_INFO: `/v3/projects/6ae9c6f153314f8b8167c03ab14c840a/users/e1f45e3726294f7b910fc43e66273aa0/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:42.729859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae9c6f153314f8b8167c03ab14c840a, user_id=e1f45e3726294f7b910fc43e66273aa0, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:42.744297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:43.038629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656738b4f5e34cf2828e2bcf78206381'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.039432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656738b4f5e34cf2828e2bcf78206381'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.061964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 813/1638] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:42 2021] PUT /identity/v3/projects/6ae9c6f153314f8b8167c03ab14c840a/users/e1f45e3726294f7b910fc43e66273aa0/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:43.066268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:43.070214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 826/1639] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:42 2021] DELETE /identity/v3/users/656738b4f5e34cf2828e2bcf78206381 => generated 0 bytes in 889 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:43.075018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:43.235010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464f74a-4e53-49cb-a2d9-edf870c57027 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:43.390425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:43.391464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:43.392276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:43.392723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:43.393648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:43.395812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:43.439099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 814/1640] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:43 2021] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:43.443968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:43.454253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:43.457469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:43.470524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9b445-5ad9-437e-b907-1b9d0b046e51 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:43.495836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef69c1-6eb5-47e1-ad73-7f844caeb794 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:43.507252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:43.508413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:43.508635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c58787-38a8-4023-ae27-db7e84b4e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:43.508879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:43.511892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58787-38a8-4023-ae27-db7e84b4e8cd admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:43.512360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] PATH_INFO: `/v3/projects/dbf89868d98e466185986dda950fe549` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:43.512657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58787-38a8-4023-ae27-db7e84b4e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:43.513171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c58787-38a8-4023-ae27-db7e84b4e8cd admin admin] PATH_INFO: `/v3/projects/6ae9c6f153314f8b8167c03ab14c840a/users/e1f45e3726294f7b910fc43e66273aa0/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:43.514051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf89868d98e466185986dda950fe549)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:43.518636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:43.528001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c58787-38a8-4023-ae27-db7e84b4e8cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae9c6f153314f8b8167c03ab14c840a, user_id=e1f45e3726294f7b910fc43e66273aa0, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:43.552715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c58787-38a8-4023-ae27-db7e84b4e8cd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:43.589256 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 827/1641] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:43 2021] PUT /identity/v3/projects/6ae9c6f153314f8b8167c03ab14c840a/users/e1f45e3726294f7b910fc43e66273aa0/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:43.600798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:43.601435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:43.601962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:43.676784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] MFA Rules not processed for user `e1f45e3726294f7b910fc43e66273aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:43.678420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:43.743843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf89868d98e466185986dda950fe549', 'request_id': 'req-03d569bd-9452-43f3-9251-0962f01cd026'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.779047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf89868d98e466185986dda950fe549', 'request_id': 'req-03d569bd-9452-43f3-9251-0962f01cd026'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.849329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf89868d98e466185986dda950fe549', 'request_id': 'req-03d569bd-9452-43f3-9251-0962f01cd026'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.889778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] The token cache is being invalidate because project dbf89868d98e466185986dda950fe549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:43.892080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.892597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-03d569bd-9452-43f3-9251-0962f01cd026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:43.895340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 815/1642] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:43 2021] DELETE /identity/v3/projects/dbf89868d98e466185986dda950fe549 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:43.901592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc1eb-98da-4316-b778-a231ef824880 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:43.901886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc1eb-98da-4316-b778-a231ef824880 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:43.902250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc1eb-98da-4316-b778-a231ef824880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:43.959702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-545fc1eb-98da-4316-b778-a231ef824880 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:43.960995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-545fc1eb-98da-4316-b778-a231ef824880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:44.022507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 828/1643] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:43 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:44.031360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:44.033670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:44.189610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 816/1644] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:44.197560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:44.202732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:44.202732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:44.239685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:44.242928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:44.258807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a476cb-9cf0-4848-86da-3188dcc09061 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:44.277773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 817/1645] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:44.278806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:44.308237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec153f-72d7-44cd-9006-0c2fe85a87ec None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:44.315645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:44.316615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:44.317128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:44.317600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:44.319251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:44.320715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:44.324810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:44.347026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 818/1646] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:44.352148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:44.382439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b9d23-2437-4e07-95d8-99017c25ae72 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:44.384269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:44.385149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:44.386105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:44.387135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:44.388196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:44.390910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:44.424117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:44.424806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:44.425140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:44.425425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:44.531353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 819/1647] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:44 2021] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:44.536929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:44.618547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:44.618547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:44.636670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 829/1648] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:44 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:44.744362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b464ada-928d-4a97-9d73-6bd96f90541a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:44.759268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:44.760382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:44.760672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:44.761318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:44.762386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:44.764435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:44.863419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 820/1649] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:44 2021] POST /identity/v3/users => generated 291 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:44.867462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:44.888142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356a76-d573-4478-bdab-835e3af0ba59 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:44.903964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:44.904682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:44.904965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:44.905241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:44.905977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:44.915926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:44.938205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:44.957823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 830/1650] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:44 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:44.973981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:45.009736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea9bd4f-7c43-4ede-969c-53eb5187df27 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:45.015063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:45.015747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.016031 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.016298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.033376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:45.038328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:45.064275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 831/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:44 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:45.065477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:45.093799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d227a7d-03b8-487e-8ff9-a06d5c7d3120 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:45.113276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f245b1b-a050-4654-9356-1c6a1d9b6fa6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:45.118169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:45.119234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.119805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.120347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.122699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:45.133492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2559e-ef6a-4b4c-a70a-c5ed4a68c210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:45.134400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2559e-ef6a-4b4c-a70a-c5ed4a68c210 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.134709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2559e-ef6a-4b4c-a70a-c5ed4a68c210 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.140694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2559e-ef6a-4b4c-a70a-c5ed4a68c210 admin admin] PATH_INFO: `/v3/projects/f4b9a02b15a54c66bf042e3ea0ea32e5/users/f08bb2ba6897466c8eaea205a0b1ae0f/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.183506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2559e-ef6a-4b4c-a70a-c5ed4a68c210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b9a02b15a54c66bf042e3ea0ea32e5, user_id=f08bb2ba6897466c8eaea205a0b1ae0f, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:45.198777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2559e-ef6a-4b4c-a70a-c5ed4a68c210 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:45.236006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:45.240136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda7bd9-1e26-41a8-a62a-95b869596a8a service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:45.253169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 821/1652] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:44 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:45.365721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4e805-5bd0-4525-8d20-2d6f256d6dd4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.366327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4e805-5bd0-4525-8d20-2d6f256d6dd4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.366716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4e805-5bd0-4525-8d20-2d6f256d6dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.377732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 832/1653] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:45 2021] PUT /identity/v3/projects/f4b9a02b15a54c66bf042e3ea0ea32e5/users/f08bb2ba6897466c8eaea205a0b1ae0f/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:45.450371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.450656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9ee4e805-5bd0-4525-8d20-2d6f256d6dd4 None None] MFA Rules not processed for user `af5ad45d471648a487e5c95cb63163e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:45.451129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.451581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.451905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9ee4e805-5bd0-4525-8d20-2d6f256d6dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:45.482313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] MFA Rules not processed for user `f08bb2ba6897466c8eaea205a0b1ae0f`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:45.483929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:45.575620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 833/1654] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:45 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:45.590945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:45.647207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 822/1655] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:45 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:45.648884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.649261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.649699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.725020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] MFA Rules not processed for user `a561148ea4c14d07a050ca8dc5787085`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:45.728088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:45.859207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd1e7d-44d0-49f5-ac44-a826cb1e5a21 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:45.875931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:45.876636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:45.877096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:45.877542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:45.878307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:45.887184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:45.940509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 823/1656] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:45 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:45.948467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:45.951811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:46.020669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 834/1657] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:45 2021] POST /identity/v3/projects => generated 381 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:15:46.024243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:46.031299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:46.094031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4314755a-ed55-4dc3-8274-a70f00f19c44 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:46.235382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa9a3d-dcef-45fc-8422-82446e49f9fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:46.236059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa9a3d-dcef-45fc-8422-82446e49f9fc service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:46.236344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa9a3d-dcef-45fc-8422-82446e49f9fc service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:46.237307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa9a3d-dcef-45fc-8422-82446e49f9fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:46.267432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6edcc-4d82-49d1-a479-12fdd35a859a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:46.285625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:46.294484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:46.295236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:46.295752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] PATH_INFO: `/v3/projects/0d6a6362fb394ea19663961e192d435f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:46.300490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6a6362fb394ea19663961e192d435f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:46.309054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:46.315677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa9a3d-dcef-45fc-8422-82446e49f9fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:46.317529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa9a3d-dcef-45fc-8422-82446e49f9fc service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:46.328826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 824/1658] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:45 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:46.341858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:46.342369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:46.343195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:46.371982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] MFA Rules not processed for user `a561148ea4c14d07a050ca8dc5787085`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:46.375079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:46.457275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 825/1659] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:46 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:46.458600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:46.462754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:46.507041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219015d4-34e1-472d-9282-dafb705efb8f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:46.522983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6a6362fb394ea19663961e192d435f', 'request_id': 'req-ea3e5642-7721-4c6c-aa11-ec4184799b0b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.551888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6a6362fb394ea19663961e192d435f', 'request_id': 'req-ea3e5642-7721-4c6c-aa11-ec4184799b0b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.652516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:46.654516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6a6362fb394ea19663961e192d435f', 'request_id': 'req-ea3e5642-7721-4c6c-aa11-ec4184799b0b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.656427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:46.656757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:46.658252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] PATH_INFO: `/v3/projects/ba32d1c097134ab4b8aaf4b36b6ed69a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:46.665421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba32d1c097134ab4b8aaf4b36b6ed69a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:46.677625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:46.679696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] The token cache is being invalidate because project 0d6a6362fb394ea19663961e192d435f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:46.681388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.687046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.693219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 835/1660] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:46 2021] DELETE /identity/v3/projects/0d6a6362fb394ea19663961e192d435f => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:46.695941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:46.700872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:46.744909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e5642-7721-4c6c-aa11-ec4184799b0b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:46.764710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bca4a-2740-4709-8579-fa8915e95050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:46.765438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bca4a-2740-4709-8579-fa8915e95050 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:46.766556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bca4a-2740-4709-8579-fa8915e95050 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:46.767034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bca4a-2740-4709-8579-fa8915e95050 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:46.779019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bca4a-2740-4709-8579-fa8915e95050 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:46.782640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bca4a-2740-4709-8579-fa8915e95050 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:46.896287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 836/1661] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:46 2021] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:46.903237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c8a4-569b-443a-bc7d-e8edc91af764 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:46.903237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c8a4-569b-443a-bc7d-e8edc91af764 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:46.903237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54c8a4-569b-443a-bc7d-e8edc91af764 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:46.903970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba32d1c097134ab4b8aaf4b36b6ed69a', 'request_id': 'req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.904062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 837/1662] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:15:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:15:46.904062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54c8a4-569b-443a-bc7d-e8edc91af764 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:46.906115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4a54c8a4-569b-443a-bc7d-e8edc91af764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:46.919235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba32d1c097134ab4b8aaf4b36b6ed69a', 'request_id': 'req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:46.980626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba32d1c097134ab4b8aaf4b36b6ed69a', 'request_id': 'req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:47.002075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] The token cache is being invalidate because project ba32d1c097134ab4b8aaf4b36b6ed69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:47.003345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:47.005870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47cbb0a2-d7df-4900-b4f6-97c56a5cb31a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:47.015663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 826/1663] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:46 2021] DELETE /identity/v3/projects/ba32d1c097134ab4b8aaf4b36b6ed69a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:47.018496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.019586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.021527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.064420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:47.067007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.200512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54c8a4-569b-443a-bc7d-e8edc91af764 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:47.212131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:47.212810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.213096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.213887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.219883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 827/1664] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:47.225231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:47.231375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.231672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.258161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdd65f-a4ef-4ff5-8749-f48e8b33aad6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:47.278400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f69d35-a71e-4d23-a460-a69636b66d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:47.279273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f69d35-a71e-4d23-a460-a69636b66d0d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.280263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f69d35-a71e-4d23-a460-a69636b66d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.280263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f69d35-a71e-4d23-a460-a69636b66d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.281062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f69d35-a71e-4d23-a460-a69636b66d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:47.282833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f69d35-a71e-4d23-a460-a69636b66d0d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:47.306902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 828/1665] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:47.309093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2b44-5cb7-4eec-a45f-4d267a084830 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.311981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2b44-5cb7-4eec-a45f-4d267a084830 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.312615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd2b44-5cb7-4eec-a45f-4d267a084830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.352269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d2fd2b44-5cb7-4eec-a45f-4d267a084830 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:47.355672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d2fd2b44-5cb7-4eec-a45f-4d267a084830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.381389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 829/1666] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:15:47 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:47.384289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.385341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.386139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.396639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:47.398932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a8d79-60a3-4c13-b601-9abdc83a6170 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:47.423045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 838/1667] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:46 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:47.430507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:47.437542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.444779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0676-bb96-440b-9cc1-95b899f87c1a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.445074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0676-bb96-440b-9cc1-95b899f87c1a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.445354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae0676-bb96-440b-9cc1-95b899f87c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.450192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 830/1668] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:47.451350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:47.463491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab2e760-3250-4515-b948-eb39bd665eb8 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:47.468987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:47.470025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.470457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.470872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] PATH_INFO: `/v3/projects/c82707e0cec84c56b13571cc9f6a2201/users/d62fc5ebd9e24bcf87806c06e3459688/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.490202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82707e0cec84c56b13571cc9f6a2201, user_id=d62fc5ebd9e24bcf87806c06e3459688, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:47.493370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:47.525886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-fcae0676-bb96-440b-9cc1-95b899f87c1a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:47.529505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fcae0676-bb96-440b-9cc1-95b899f87c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.565700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 839/1669] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:47.571793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.599586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 831/1670] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:47 2021] PUT /identity/v3/projects/c82707e0cec84c56b13571cc9f6a2201/users/d62fc5ebd9e24bcf87806c06e3459688/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:47.599586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:47.602444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.602444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.665909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:47.669535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:47.799419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aa708-3cee-45c2-b3ff-a3555e07404c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:47.845440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:47.846270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.846429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.846737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.847474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:47.856467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:47.865749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:47.937129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 832/1671] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:47.941688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 840/1672] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:47.942195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:47.942286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:47.980132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac556b2-4ed3-46e1-97f5-db229ec301b2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:47.981437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809aaae-febd-41b6-97da-bc506af89f81 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:47.991302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:47.991953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:47.992959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.993243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.993521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.994235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:47.995261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:47.995607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:47.995887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:47.996959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:48.000821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:48.003242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:48.027971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 833/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:47 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:48.035579 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:48.094935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7497f0-1699-47b9-a917-b585143f4f00 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:48.111446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:48.113227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:48.113227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:48.113227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:48.113507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:48.113685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:48.115338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:48.144027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 834/1674] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:48.144994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:48.164761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee08eb-746c-4f60-a75a-78650b0537e7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:48.167250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 841/1675] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:47 2021] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:48.170526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:48.313981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:48.315033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:48.316081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:48.317154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] PATH_INFO: `/v3/projects/c82707e0cec84c56b13571cc9f6a2201/users/d62fc5ebd9e24bcf87806c06e3459688/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:48.320009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82707e0cec84c56b13571cc9f6a2201, user_id=d62fc5ebd9e24bcf87806c06e3459688, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:48.487140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:48.487140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 835/1676] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:48 2021] PUT /identity/v3/projects/c82707e0cec84c56b13571cc9f6a2201/users/d62fc5ebd9e24bcf87806c06e3459688/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:48.487140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:48.490064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de410e27-4a95-4012-ac39-0585f2f0cd38 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:48.550676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb502c-80a1-43d6-9832-dcc643de1475 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:48.565692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:48.566611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:48.567048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:48.567478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:48.568369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:48.570462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:48.596259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db877203-4617-4042-a629-edfe68d7087a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:48.664169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877203-4617-4042-a629-edfe68d7087a admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:48.664169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877203-4617-4042-a629-edfe68d7087a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:48.664169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db877203-4617-4042-a629-edfe68d7087a admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:48.664169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db877203-4617-4042-a629-edfe68d7087a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:48.664169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db877203-4617-4042-a629-edfe68d7087a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:49.012330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 836/1677] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:48 2021] POST /identity/v3/users => generated 284 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:49.013498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:49.016743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:49.031383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 842/1678] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:48 2021] POST /identity/v3/projects => generated 383 bytes in 860 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:49.036483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ae7b-5db7-4f1c-8b4a-f01bd8460644 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.036830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ae7b-5db7-4f1c-8b4a-f01bd8460644 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.037112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9ae7b-5db7-4f1c-8b4a-f01bd8460644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.132996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d9f9ae7b-5db7-4f1c-8b4a-f01bd8460644 None None] MFA Rules not processed for user `d62fc5ebd9e24bcf87806c06e3459688`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:49.134715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d9f9ae7b-5db7-4f1c-8b4a-f01bd8460644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:49.260461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09d56-8df7-416f-b9f5-271cd2364974 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:49.305320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:49 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:49.305320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac6178-ee08-4afb-8135-6633932027b3 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.305320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac6178-ee08-4afb-8135-6633932027b3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.306463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac6178-ee08-4afb-8135-6633932027b3 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.322106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 844/1680] 10.222.0.16 () {54 vars in 912 bytes} [Tue Aug 10 05:15:49 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:15:49.324518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.325081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.325583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.352867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] MFA Rules not processed for user `490a8522f743475187844c39a4ba6dea`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:49.356412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:49.380090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:49.381295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.381785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.382270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.409914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:49.415277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:49.454840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 837/1681] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:49 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:49.459320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:49.482967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 845/1682] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:49 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:49.482967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:49.595108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040889e-cdbb-4683-b034-1938c26b1bb0 service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:49.596733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a189c0-395e-45e7-a0b9-a6823e5c5af4 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:49.601635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:49.602012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406a42-e668-485e-ab16-ab71a097ac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:49.602733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406a42-e668-485e-ab16-ab71a097ac4e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.603016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406a42-e668-485e-ab16-ab71a097ac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.603290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406a42-e668-485e-ab16-ab71a097ac4e admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.603720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.604012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406a42-e668-485e-ab16-ab71a097ac4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:49.606773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.606902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406a42-e668-485e-ab16-ab71a097ac4e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:49.616871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.618879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:49.624310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:49.644081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 838/1683] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:49 2021] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:49.649077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:49.649077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:49.710711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 846/1684] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:49 2021] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:49.712955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.719266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.719864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.818148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:49.831968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:49.843338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c6854-b441-4dbd-8964-13f9dd896d63 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:49.855513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:49.861039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:49.861039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:49.861039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:49.903506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:49.907862 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:49.968541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 839/1685] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:49 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:49.969694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:49.981614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 847/1686] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:15:49 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:49.983494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.014555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602386d1-6408-43c6-9f83-7d39ed2e19b5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.044907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.044907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.044907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.044907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.045748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef69e9b-0623-41b3-9a49-08a0e9580e50 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.051616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:50.056554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:50.063292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.064004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.064259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.064532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.065264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:50.077730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:50.106458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 848/1687] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:49 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:50.110309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 840/1688] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:49 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:50.116974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.122935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.126930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:50.149950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789a7d88-7677-4fce-9e57-4acb4ad7eeee admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.156971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.161424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.162000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.162496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.164079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:50.165799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:50.168643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9373a9-ee90-4458-9869-8cf815c75fd3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.182806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 841/1689] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:50 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:50.184227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.196040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.198503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.199656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.201299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.206818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5fdddd-8e8d-45d2-9751-c6bc54b88929 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.212876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d84e68-ccf6-4237-94c0-77f5a79b9c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.215250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d84e68-ccf6-4237-94c0-77f5a79b9c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.216180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d84e68-ccf6-4237-94c0-77f5a79b9c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.217026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d84e68-ccf6-4237-94c0-77f5a79b9c5f admin admin] PATH_INFO: `/v3/projects/3518d98a43e1485d9c0a75d09a7c1121/users/edfd7da0d8404643b52600233deffcbd/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.222852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:50.227693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:50.250961 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 849/1690] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:50.251874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.268381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d84e68-ccf6-4237-94c0-77f5a79b9c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3518d98a43e1485d9c0a75d09a7c1121, user_id=edfd7da0d8404643b52600233deffcbd, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:50.271469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d84e68-ccf6-4237-94c0-77f5a79b9c5f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:50.290185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63c27d-199b-4dae-94d9-8909acc66715 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.305048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b57e00c-b262-42a3-a95b-4b3084cfc1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.306131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e00c-b262-42a3-a95b-4b3084cfc1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.306425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e00c-b262-42a3-a95b-4b3084cfc1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.306744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b57e00c-b262-42a3-a95b-4b3084cfc1fb admin admin] PATH_INFO: `/v3/projects/ac9a2e73e7434a44ab13d9adbce25de0/users/03d4c6797c324248bc93ed4c7a226044/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.375869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 842/1691] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:50 2021] PUT /identity/v3/projects/3518d98a43e1485d9c0a75d09a7c1121/users/edfd7da0d8404643b52600233deffcbd/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:50.379177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.379932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.380336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.420736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e00c-b262-42a3-a95b-4b3084cfc1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac9a2e73e7434a44ab13d9adbce25de0, user_id=03d4c6797c324248bc93ed4c7a226044, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:50.425981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b57e00c-b262-42a3-a95b-4b3084cfc1fb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:50.481581 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] MFA Rules not processed for user `edfd7da0d8404643b52600233deffcbd`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:50.486248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:50.524038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 850/1692] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:50 2021] PUT /identity/v3/projects/ac9a2e73e7434a44ab13d9adbce25de0/users/03d4c6797c324248bc93ed4c7a226044/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:50.588444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.588767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.589023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:50.672920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] MFA Rules not processed for user `03d4c6797c324248bc93ed4c7a226044`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:50.675027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:50.680361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 843/1693] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:50 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:50.699711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.831128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd08a2-4240-4fe6-ac64-99c3a41e995f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:50.859034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 851/1694] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:50.864195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:50.925413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:50.926737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:50.927133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:50.930480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:51.027885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf70a93-fc16-4a12-aa8c-ffa2e4ba6020 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:51.031692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:51.034655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:51.038032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:51.039739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:51.040178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:51.040600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:51.041560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:51.044322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:51.079647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 844/1695] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:50 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:51.333194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 852/1696] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:50 2021] POST /identity/v3/projects => generated 383 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:51.333770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:51.361446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1585404-1b72-479f-89b3-24a22b61531b service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:51.533347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:51.534092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:51.534383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:51.534689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:51.535469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:51.537578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:51.704978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 845/1697] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:51 2021] POST /identity/v3/users => generated 298 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:51.709853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:51.725517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b63d626-ed02-483b-bb38-9d8a0dcee13c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:51.733326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:51.735788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:51.736276 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:51.737161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:51.738332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:51.745214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:51.771060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 853/1698] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:51 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:51.772018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:51.789514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86789c0a-6780-484c-b656-ff469f0f9d60 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:51.816673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:51.816673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:51.816673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:51.818819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] PATH_INFO: `/v3/projects/be3bcb05c8fb471f87ad26d402170063/users/4715a0a2c0e940e38548c930370cf0bc/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:51.883991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3bcb05c8fb471f87ad26d402170063, user_id=4715a0a2c0e940e38548c930370cf0bc, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:51.887666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:51.996212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 846/1699] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:51 2021] PUT /identity/v3/projects/be3bcb05c8fb471f87ad26d402170063/users/4715a0a2c0e940e38548c930370cf0bc/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:52.000169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:52.018100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5445f6ac-79dc-4d30-875b-e74bbe646fcf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:52.067158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:52.264941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fd6f1-10c9-40aa-acba-04f66f2ba9dd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:52.270808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd62fc5ebd9e24bcf87806c06e3459688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c82707e0cec84c56b13571cc9f6a2201', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:52.274419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.274419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.274419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.274839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:52.274938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:52.274938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:52.275369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.275570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.275859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.277636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:52.282071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:52.300042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:52.310937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 847/1700] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:52.314283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:52.337602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58942464-b506-4ff8-ba5e-526c97e16019 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:52.363529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 854/1701] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:51 2021] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:52.368223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:52.386138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd62fc5ebd9e24bcf87806c06e3459688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c82707e0cec84c56b13571cc9f6a2201', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:52.389810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.390110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.390399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.397362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:52.411952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7583a3d-e630-42c4-9666-26f2c6c76b2b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:52.415149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:52.453530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad513d-37ab-496f-8ee3-800c9294167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:52.454766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad513d-37ab-496f-8ee3-800c9294167a admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.455249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad513d-37ab-496f-8ee3-800c9294167a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.455697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad513d-37ab-496f-8ee3-800c9294167a admin admin] PATH_INFO: `/v3/projects/be3bcb05c8fb471f87ad26d402170063/users/4715a0a2c0e940e38548c930370cf0bc/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.460086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad513d-37ab-496f-8ee3-800c9294167a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3bcb05c8fb471f87ad26d402170063, user_id=4715a0a2c0e940e38548c930370cf0bc, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:52.471984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad513d-37ab-496f-8ee3-800c9294167a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:52.527785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 855/1702] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:52 2021] PUT /identity/v3/projects/be3bcb05c8fb471f87ad26d402170063/users/4715a0a2c0e940e38548c930370cf0bc/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:52.527785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971864-402a-4850-894a-e910ed149083 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.527785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971864-402a-4850-894a-e910ed149083 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.527785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971864-402a-4850-894a-e910ed149083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.578990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bc971864-402a-4850-894a-e910ed149083 None None] MFA Rules not processed for user `4715a0a2c0e940e38548c930370cf0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:52.580706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bc971864-402a-4850-894a-e910ed149083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:52.629139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 848/1703] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:52 2021] POST /identity/v3/projects => generated 355 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:52.629139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:52.754849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 856/1704] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:52 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:52.756312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.756618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.756882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.810166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] MFA Rules not processed for user `a561148ea4c14d07a050ca8dc5787085`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:52.812066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:52.815904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dab337-e89c-4e2c-8df5-c9d7bdeae50e tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:52.828634 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd62fc5ebd9e24bcf87806c06e3459688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c82707e0cec84c56b13571cc9f6a2201', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:52.829430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:52.829912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:52.830217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:52.831091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:52.831467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:52.833545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:52.849675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 849/1705] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:15:52.852108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:52.933047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 857/1706] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:52 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:53.044711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8dede-9f1f-48d2-ad39-cb96fc0c5ebe tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:53.049130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:53.050612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:53.051109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:53.051493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:53.169045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:53.190908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd8258-de0d-4fad-8249-1efa2329f21d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:53.206227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd62fc5ebd9e24bcf87806c06e3459688', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c82707e0cec84c56b13571cc9f6a2201', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:53.209671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:53.209671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:53.209671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] PATH_INFO: `/v3/projects/87c7296b64a14045901203ee695ab306` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:53.214032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87c7296b64a14045901203ee695ab306)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:53.216032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:53.231713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:53.234725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:53.258841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 850/1707] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:52 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:53.458107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:53.470699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa60bc-9b08-43a0-8b15-cb571f6bd8a2 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:53.509208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c7296b64a14045901203ee695ab306', 'request_id': 'req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:53.537572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c7296b64a14045901203ee695ab306', 'request_id': 'req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:53.628633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c7296b64a14045901203ee695ab306', 'request_id': 'req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:53.648068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] The token cache is being invalidate because project 87c7296b64a14045901203ee695ab306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:53.657550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:53.659483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-31b9e54d-9b07-4ce8-831b-7c17cafff6c3 tempest-VolumeQuotaClassesTest-1221747741 tempest-VolumeQuotaClassesTest-1221747741-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:53.670296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 858/1708] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:53 2021] DELETE /identity/v3/projects/87c7296b64a14045901203ee695ab306 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:53.686469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:53.686469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:53.686469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:53.686469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:53.687932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:53.828552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:53.835129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:53.868822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 851/1709] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:53 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:15:54.753363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33223c-5013-45d9-935f-a7a3a6bd4b06 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:54.753918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33223c-5013-45d9-935f-a7a3a6bd4b06 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:54.754139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33223c-5013-45d9-935f-a7a3a6bd4b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:54.781156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ba33223c-5013-45d9-935f-a7a3a6bd4b06 None None] MFA Rules not processed for user `af5ad45d471648a487e5c95cb63163e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:54.783027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ba33223c-5013-45d9-935f-a7a3a6bd4b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:54.968651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 859/1710] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:54 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:54.987656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:54.990019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:55.114704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d668f4f2-9d77-49dd-bd00-04945595f7cc service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:55.119501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:55.120433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:55.120723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:55.121001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] PATH_INFO: `/v3/users/f08bb2ba6897466c8eaea205a0b1ae0f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:55.122222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f08bb2ba6897466c8eaea205a0b1ae0f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:55.124227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:55.340559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f08bb2ba6897466c8eaea205a0b1ae0f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:55.353573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f08bb2ba6897466c8eaea205a0b1ae0f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:55.456829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f08bb2ba6897466c8eaea205a0b1ae0f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:55.464723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f08bb2ba6897466c8eaea205a0b1ae0f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:55.465404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f08bb2ba6897466c8eaea205a0b1ae0f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:55.471416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 852/1711] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:54 2021] DELETE /identity/v3/users/f08bb2ba6897466c8eaea205a0b1ae0f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:55.475966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:55.476273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:55.476634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:55.497558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:55.498885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:55.577853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 860/1712] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:55.590281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:55.594960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:55.668938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f739d-c389-4163-8200-337bae12c85c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:55.672921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:55.673580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:55.674038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:55.674324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:55.684646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:55.686085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:55.696206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 853/1713] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:56.142026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:56.143592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:56.157975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa3eb51-3d89-4a4f-844a-8645530db069 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:56.162953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:56.163844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:56.164124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:56.164395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] PATH_INFO: `/v3/projects/f4b9a02b15a54c66bf042e3ea0ea32e5` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:56.165915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b9a02b15a54c66bf042e3ea0ea32e5)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:56.168059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:56.319579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b9a02b15a54c66bf042e3ea0ea32e5', 'request_id': 'req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.326077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b9a02b15a54c66bf042e3ea0ea32e5', 'request_id': 'req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.388250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b9a02b15a54c66bf042e3ea0ea32e5', 'request_id': 'req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.398932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] The token cache is being invalidate because project f4b9a02b15a54c66bf042e3ea0ea32e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:56.399219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.399844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.402002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 861/1714] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:56 2021] DELETE /identity/v3/projects/f4b9a02b15a54c66bf042e3ea0ea32e5 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:56.405979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:56.415608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78195c05-ec98-4b13-90d9-e410bd717b65 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:56.479968 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:56.481118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:56.481397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:56.481669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] PATH_INFO: `/v3/users/d62fc5ebd9e24bcf87806c06e3459688` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:56.483000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d62fc5ebd9e24bcf87806c06e3459688)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:56.485058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:56.683675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd62fc5ebd9e24bcf87806c06e3459688'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.699035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd62fc5ebd9e24bcf87806c06e3459688'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.748514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd62fc5ebd9e24bcf87806c06e3459688'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.756541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd62fc5ebd9e24bcf87806c06e3459688'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.757739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c93778d-1a7f-4246-9f18-1a94f0a5e7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd62fc5ebd9e24bcf87806c06e3459688'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:56.764770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 854/1715] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:56 2021] DELETE /identity/v3/users/d62fc5ebd9e24bcf87806c06e3459688 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:57.229879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:57.235939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:57.255429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39b4c2-ce0b-4fea-a3e7-f2cdb7982e93 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:57.318523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:57.319420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:57.319700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:57.319968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] PATH_INFO: `/v3/projects/c82707e0cec84c56b13571cc9f6a2201` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:57.321148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82707e0cec84c56b13571cc9f6a2201)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:57.323642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:57.481664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82707e0cec84c56b13571cc9f6a2201', 'request_id': 'req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:57.489062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82707e0cec84c56b13571cc9f6a2201', 'request_id': 'req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:57.554480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82707e0cec84c56b13571cc9f6a2201', 'request_id': 'req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:57.567006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] The token cache is being invalidate because project c82707e0cec84c56b13571cc9f6a2201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:15:57.567297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:57.568195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-15f3174c-8d51-4ac4-ba57-e1982dee9bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:57.570557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 862/1716] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:15:57 2021] DELETE /identity/v3/projects/c82707e0cec84c56b13571cc9f6a2201 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:57.577284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:57.577746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:57.577851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:57.598953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:57.600177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:57.665105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 855/1717] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:57.673914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:57.674231 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:57.674551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:57.694152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:57.695374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:57.709498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 863/1718] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:15:57.712791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:57.724829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5cebe-36af-40fc-883b-73b5d607fa54 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:57.749723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:57.751299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:57.751726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:57.752169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:57.753034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:15:57.753479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:57.756615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:57.799584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 856/1719] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:15:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:15:57.809232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:57.825518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca24c7-e502-4ae4-ab2d-358e1b7b77ce None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:57.830850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:57.831612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:57.831892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:57.832162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:57.832878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:57.834936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:57.901012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 864/1720] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:15:57 2021] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:57.906716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:57.942278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea4daa-743b-424d-8efc-40c858308e6a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:58.076800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:58.077568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.078142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.078491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.079324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:58.082043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:58.207809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 857/1721] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:15:57 2021] POST /identity/v3/users => generated 287 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:15:58.212039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:58.224154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef90698-e0be-4180-9855-30e3b19178d4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:58.230383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:58.231236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.231377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.231633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.232363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:58.234080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:58.245889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 865/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:58.249668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:58.260439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdfee42-aa95-4a71-a45c-d32e8161050f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:58.265386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75206fb6-8eb9-4a64-93b7-a47982576f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:58.270854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75206fb6-8eb9-4a64-93b7-a47982576f4e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.270854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75206fb6-8eb9-4a64-93b7-a47982576f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.270854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75206fb6-8eb9-4a64-93b7-a47982576f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.270854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75206fb6-8eb9-4a64-93b7-a47982576f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:58.270854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75206fb6-8eb9-4a64-93b7-a47982576f4e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:58.283199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 858/1723] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:15:58.284377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:58.296578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625acfa-baaa-485a-b252-fee0d867f9f2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:58.307884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:58.307884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.307884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.307884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] PATH_INFO: `/v3/projects/b33f9d01492d4123aa1ba8d2b245f093/users/86e7e59a8e244892b71943ab02fb757b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.320773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b33f9d01492d4123aa1ba8d2b245f093, user_id=86e7e59a8e244892b71943ab02fb757b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:58.323640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:58.445722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 866/1724] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:15:58 2021] PUT /identity/v3/projects/b33f9d01492d4123aa1ba8d2b245f093/users/86e7e59a8e244892b71943ab02fb757b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:15:58.451106 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.451524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.452350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.480802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:58.483680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:58.560643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 859/1725] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:58.575549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:58.577264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:58.674496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743f4fb-2e70-474b-806d-968ef2d60419 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:58.679365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:58.688824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:58.689230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068613c-3fb4-4af5-9975-4b9f5e8add93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:58.689230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068613c-3fb4-4af5-9975-4b9f5e8add93 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.689230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068613c-3fb4-4af5-9975-4b9f5e8add93 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.689230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068613c-3fb4-4af5-9975-4b9f5e8add93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.699476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068613c-3fb4-4af5-9975-4b9f5e8add93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:58.704924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068613c-3fb4-4af5-9975-4b9f5e8add93 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:58.706421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf1530-718f-48f0-977b-994d13bcb8f3 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:58.719394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:58.723195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:58.723841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:58.724265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] PATH_INFO: `/v3/users/03d4c6797c324248bc93ed4c7a226044` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:58.725778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03d4c6797c324248bc93ed4c7a226044)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:58.728049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 867/1726] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:15:58.738850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:59.048955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03d4c6797c324248bc93ed4c7a226044'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:59.072672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03d4c6797c324248bc93ed4c7a226044'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:59.196084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03d4c6797c324248bc93ed4c7a226044'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:59.221935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03d4c6797c324248bc93ed4c7a226044'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:59.234856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03d4c6797c324248bc93ed4c7a226044'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:15:59.263378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 860/1727] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:15:58 2021] DELETE /identity/v3/users/03d4c6797c324248bc93ed4c7a226044 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:15:59.264161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:59.264648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:59.264719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:59.285020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:15:59.286699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:59.389975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 868/1728] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:15:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:15:59.448578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:15:59.450015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:15:59.579476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014b19-589b-43f1-8698-8b9c08fb7be1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:15:59.585039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:15:59.585890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:15:59.586362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:15:59.590291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:15:59.608676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:15:59.611409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:15:59.626525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 861/1729] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:15:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:00.963068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:00.964651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:00.991232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2ad1a-e5e2-44de-9da2-bbe2436b2005 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:01.004739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:01.005968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:01.006640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:01.007090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] PATH_INFO: `/v3/projects/ac9a2e73e7434a44ab13d9adbce25de0` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:01.008839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac9a2e73e7434a44ab13d9adbce25de0)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:01.012500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:01.187370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9a2e73e7434a44ab13d9adbce25de0', 'request_id': 'req-f9e64c43-c1fa-4f61-8c60-60bb77648391'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.202411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9a2e73e7434a44ab13d9adbce25de0', 'request_id': 'req-f9e64c43-c1fa-4f61-8c60-60bb77648391'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.326850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9a2e73e7434a44ab13d9adbce25de0', 'request_id': 'req-f9e64c43-c1fa-4f61-8c60-60bb77648391'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.350990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] The token cache is being invalidate because project ac9a2e73e7434a44ab13d9adbce25de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:01.350990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.350990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f9e64c43-c1fa-4f61-8c60-60bb77648391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.350990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 869/1730] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:00 2021] DELETE /identity/v3/projects/ac9a2e73e7434a44ab13d9adbce25de0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:01.356947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:01.367563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d52db6-2e77-412e-84b3-d1ff8841ab0e service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:01.565041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:01.565964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:01.566248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:01.566566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] PATH_INFO: `/v3/users/4715a0a2c0e940e38548c930370cf0bc` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:01.570963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4715a0a2c0e940e38548c930370cf0bc)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:01.576613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:01.841979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4715a0a2c0e940e38548c930370cf0bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.853768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4715a0a2c0e940e38548c930370cf0bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.986859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4715a0a2c0e940e38548c930370cf0bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:01.998534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4715a0a2c0e940e38548c930370cf0bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:02.000140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4715a0a2c0e940e38548c930370cf0bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:02.014897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 862/1731] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:01 2021] DELETE /identity/v3/users/4715a0a2c0e940e38548c930370cf0bc => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:02.119419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:02.120464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:02.120551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:02.170683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] MFA Rules not processed for user `86e7e59a8e244892b71943ab02fb757b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:02.172964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:02.325819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 870/1732] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:02 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:02.330037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:02.331621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:02.446460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff275b7a-68c3-497b-a2c1-06ad83aeb984 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:02.451538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:02.452520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:02.452946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:02.453361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:02.454224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:02.456665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:02.603353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 863/1733] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:02 2021] POST /identity/v3/projects => generated 371 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:02.607311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:02.622458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497a2b-33f9-402f-ae34-b4293d1cc150 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:02.705139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:02.706199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:02.706708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:02.707125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:02.711749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:02.711749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:02.888265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 871/1734] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:02 2021] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:02.893361 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:02.918217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba9b4f-a9b2-478c-ab10-21ffbecf373a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:02.933783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8d80a-1615-4620-86e6-fba967dab8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:02.934486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8d80a-1615-4620-86e6-fba967dab8af admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:02.934794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8d80a-1615-4620-86e6-fba967dab8af admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:02.946848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8d80a-1615-4620-86e6-fba967dab8af admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:02.947944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8d80a-1615-4620-86e6-fba967dab8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:02.949598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8d80a-1615-4620-86e6-fba967dab8af admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:02.967436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 864/1735] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:02.971418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:02.991268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b994dd5-c86f-4e8f-8139-ef5132787778 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:03.001244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:03.002417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.002989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.003398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] PATH_INFO: `/v3/projects/fa2f0c1f38d74a25b0b08066744dee1f/users/2e8ff804ac7e426eaf45bf9bc211376f/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.039856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2f0c1f38d74a25b0b08066744dee1f, user_id=2e8ff804ac7e426eaf45bf9bc211376f, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:03.050404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:03.156455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9216ab-4bdf-48c0-8a70-61ee3292f8a0 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.157359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9216ab-4bdf-48c0-8a70-61ee3292f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.157359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9216ab-4bdf-48c0-8a70-61ee3292f8a0 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.159018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 865/1736] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:16:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 10 05:16:03.169696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.170165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.175670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.185825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 872/1737] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:02 2021] PUT /identity/v3/projects/fa2f0c1f38d74a25b0b08066744dee1f/users/2e8ff804ac7e426eaf45bf9bc211376f/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:03.189937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:03.211703 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:03.212939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:03.314443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4fbe3-254c-4a2b-846d-a6abc98b0d25 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:03.324766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:03.328195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.328878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.329970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.332799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:03.336156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:03.351613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 873/1738] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:03 2021] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:03.358377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:03.375642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 866/1739] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:16:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:03.390919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449bb3-67e8-4c33-a398-51da0c6baec0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:03.397490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ed8b-afe6-4069-995b-6d6fc3028698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:03.398785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ed8b-afe6-4069-995b-6d6fc3028698 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.399864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ed8b-afe6-4069-995b-6d6fc3028698 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.400244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:03.401385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ed8b-afe6-4069-995b-6d6fc3028698 admin admin] PATH_INFO: `/v3/projects/fa2f0c1f38d74a25b0b08066744dee1f/users/2e8ff804ac7e426eaf45bf9bc211376f/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.402727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:03.413693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273ed8b-afe6-4069-995b-6d6fc3028698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2f0c1f38d74a25b0b08066744dee1f, user_id=2e8ff804ac7e426eaf45bf9bc211376f, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:03.424427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273ed8b-afe6-4069-995b-6d6fc3028698 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:03.425833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb11ca-0c71-4984-86ad-5b8e59551250 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:03.438857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:03.442295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.442295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.442295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.445414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 874/1740] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:03 2021] PUT /identity/v3/projects/fa2f0c1f38d74a25b0b08066744dee1f/users/2e8ff804ac7e426eaf45bf9bc211376f/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:03.464159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:03.465900 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:03.477843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 867/1741] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:03 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:03.614318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f21e-b29e-4327-9fd4-c761e9d3e241 None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.614692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f21e-b29e-4327-9fd4-c761e9d3e241 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.614979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f21e-b29e-4327-9fd4-c761e9d3e241 None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.619297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 875/1742] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:16:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:16:03.625073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:03.626641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:03.647675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860feb6-aec5-477a-b0a6-a19962e75b9a service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:03.694816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52c795-d295-417a-b0f6-e4bafe5de015 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.695132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52c795-d295-417a-b0f6-e4bafe5de015 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.695500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52c795-d295-417a-b0f6-e4bafe5de015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.722259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-5b52c795-d295-417a-b0f6-e4bafe5de015 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:03.723676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5b52c795-d295-417a-b0f6-e4bafe5de015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:03.799138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 876/1743] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:16:03 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:03.823782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:03.824825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:03.825092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:03.825435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] PATH_INFO: `/v3/projects/be3bcb05c8fb471f87ad26d402170063` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:03.829059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3bcb05c8fb471f87ad26d402170063)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:03.829059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:03.983484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3bcb05c8fb471f87ad26d402170063', 'request_id': 'req-10b82f71-3ad6-464a-8856-24e93316eaf1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:03.993902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3bcb05c8fb471f87ad26d402170063', 'request_id': 'req-10b82f71-3ad6-464a-8856-24e93316eaf1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:04.108541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3bcb05c8fb471f87ad26d402170063', 'request_id': 'req-10b82f71-3ad6-464a-8856-24e93316eaf1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:04.131184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] The token cache is being invalidate because project be3bcb05c8fb471f87ad26d402170063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:04.131516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:04.132976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b82f71-3ad6-464a-8856-24e93316eaf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:04.142764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 868/1744] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:03 2021] DELETE /identity/v3/projects/be3bcb05c8fb471f87ad26d402170063 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:04.146121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.147139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.147715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.189251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:04.191302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:04.296257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 877/1745] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:04.313147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.314113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.314563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.322208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:04.324776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:04.355878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:04.357552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:04.370165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 869/1746] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:04.375414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:04.389672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5195f-e895-4020-9d68-365fdc3764e4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:04.397202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:04.398164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.398770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.399500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.402904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:04.403436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:04.405520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:04.463920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 870/1747] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:04.467852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:04.491106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2602a-4e72-4873-ae67-46ab4a4a7e09 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:04.495504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518dfe9-edda-4de4-a9a5-e08116cdefac admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:04.506033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:04.508676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.509039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.509408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:04.510301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.510471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.510625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.510887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.511478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:04.513250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:04.517023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:04.531926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:04.534092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:04.555718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 878/1748] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:04 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:04.691662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:04.699040 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 871/1749] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:04 2021] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:04.708101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe04cd-b6ce-4536-93e6-d5b9a14072a5 service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:04.782275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:04.783098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.783381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.783659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.784867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:04.787678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:04.895605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 879/1750] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:04 2021] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:04.899620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:04.913258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec5b14-7522-4d48-9be8-47270b9331b7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:04.920073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:04.925310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.925310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.925310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.925310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:04.927488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:04.959186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 872/1751] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:04 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:04.966818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:04.981750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd75933-518b-4797-9280-0235a18f2b0e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:04.989499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d3aee-721c-4d3b-9ab3-cd8f611f99d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:04.991220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3aee-721c-4d3b-9ab3-cd8f611f99d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:04.991676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3aee-721c-4d3b-9ab3-cd8f611f99d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:04.992430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d3aee-721c-4d3b-9ab3-cd8f611f99d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:04.993935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d3aee-721c-4d3b-9ab3-cd8f611f99d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:04.997355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d3aee-721c-4d3b-9ab3-cd8f611f99d6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.015457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.016491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 880/1752] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:04 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:05.026811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7248fb-5ce2-411d-b292-f05b8ca64585 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.032685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.033829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.034176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.035120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] PATH_INFO: `/v3/projects/c42ae5b8749c49578d4ba664d426c9ae/users/606b5b4b36f24fa3b58355f99b23af05/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.058876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42ae5b8749c49578d4ba664d426c9ae, user_id=606b5b4b36f24fa3b58355f99b23af05, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.062010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.136322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 873/1753] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:05 2021] PUT /identity/v3/projects/c42ae5b8749c49578d4ba664d426c9ae/users/606b5b4b36f24fa3b58355f99b23af05/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:05.145150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.145618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.145905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.175837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] MFA Rules not processed for user `606b5b4b36f24fa3b58355f99b23af05`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:05.176834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:05.201759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.204310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:05.256314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 881/1754] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:05 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:05.268497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.298801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62acfd6-22a6-4492-b659-3064d374728c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.305650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.306846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.307884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.312411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] PATH_INFO: `/v3/users/edfd7da0d8404643b52600233deffcbd` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.312411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edfd7da0d8404643b52600233deffcbd)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.312411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.355201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4058b-d2e5-409e-a8d4-e111f616ffa0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.364237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.365098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.365335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.365667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.366556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.368626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.533684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 882/1755] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:05 2021] POST /identity/v3/projects => generated 381 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:05.534841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.572165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edfd7da0d8404643b52600233deffcbd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:05.602976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edfd7da0d8404643b52600233deffcbd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:05.641357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9858b-4626-4e50-86d6-ce65129d6d43 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.647324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.648144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.649283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.649654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.651167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.653836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.686368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edfd7da0d8404643b52600233deffcbd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:05.694832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edfd7da0d8404643b52600233deffcbd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:05.695625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3fc2024e-95d3-4558-a3f3-9f40e4bb02a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edfd7da0d8404643b52600233deffcbd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:05.705974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 874/1756] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:05 2021] DELETE /identity/v3/users/edfd7da0d8404643b52600233deffcbd => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:05.710992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.711562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.711994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.754133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:05.756121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:05.779662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 883/1757] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:05 2021] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:05.780745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.782470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:05.812431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031815a5-4ac9-4a2b-a316-bf72ba247893 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.862663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 875/1758] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:05.877819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.879276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:05.897143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.897985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.898375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.898787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.899523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.901786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.916097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 884/1759] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:05 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:05.918054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:05.932896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a7632b-afc6-4bfb-9eb0-1449ded4a115 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.938088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.939086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.940300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.940587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] PATH_INFO: `/v3/projects/9d524280fe3444fbafd53f02768e6a5c/users/71d8753bc4df4def8dc32e5fee5c4a54/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.958246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d524280fe3444fbafd53f02768e6a5c, user_id=71d8753bc4df4def8dc32e5fee5c4a54, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.961344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:05.971656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473469a-c447-4cfd-8edd-c98f69ec0cf7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:05.976762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:05.980177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:05.980578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:05.981130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:05.995261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:05.997942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:06.011661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 876/1760] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:16:06.080266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 885/1761] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:05 2021] PUT /identity/v3/projects/9d524280fe3444fbafd53f02768e6a5c/users/71d8753bc4df4def8dc32e5fee5c4a54/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:06.084326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:06.099332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cffc95-7113-4a45-a7c0-809e480f8896 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:06.177831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc94d69-0d09-4d8b-bed3-738ddf930693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:06.178943 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94d69-0d09-4d8b-bed3-738ddf930693 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:06.179736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94d69-0d09-4d8b-bed3-738ddf930693 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:06.179877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc94d69-0d09-4d8b-bed3-738ddf930693 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:06.181023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc94d69-0d09-4d8b-bed3-738ddf930693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:06.183397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc94d69-0d09-4d8b-bed3-738ddf930693 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:06.196128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 877/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:06 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:06.200283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:06.211527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd427623-9229-4e2b-82fe-3cd9dc80dbde admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:06.217116 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:06.218019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:06.218306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:06.218608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] PATH_INFO: `/v3/projects/9d524280fe3444fbafd53f02768e6a5c/users/71d8753bc4df4def8dc32e5fee5c4a54/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:06.220976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d524280fe3444fbafd53f02768e6a5c, user_id=71d8753bc4df4def8dc32e5fee5c4a54, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:06.223761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:06.236689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 886/1763] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:06 2021] PUT /identity/v3/projects/9d524280fe3444fbafd53f02768e6a5c/users/71d8753bc4df4def8dc32e5fee5c4a54/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:06.247436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdc03e-801e-446c-8ef1-8f891507d7de None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:06.247729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdc03e-801e-446c-8ef1-8f891507d7de None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:06.248011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdc03e-801e-446c-8ef1-8f891507d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:06.276773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7acdc03e-801e-446c-8ef1-8f891507d7de None None] MFA Rules not processed for user `71d8753bc4df4def8dc32e5fee5c4a54`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:06.278006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7acdc03e-801e-446c-8ef1-8f891507d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:06.364751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 878/1764] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:06 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:06.375474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:06.378074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:06.460002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543221b9-6ef9-47ad-8447-00f563822b5f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:06.464675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:06.465435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:06.465786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:06.466130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:06.477553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:06.479709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:06.492640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 887/1765] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:06 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:06.679640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:06.680155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:06.680621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:06.696867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:06.698142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:06.774678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] MFA Rules not processed for user `2e8ff804ac7e426eaf45bf9bc211376f`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:06.778395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:06.867743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770836-6f13-4cff-93c9-fab86939059a service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:06.880432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:06.881651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:06.883896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:06.884408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] PATH_INFO: `/v3/projects/3518d98a43e1485d9c0a75d09a7c1121` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:06.890951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3518d98a43e1485d9c0a75d09a7c1121)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:06.893034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:06.951940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 879/1766] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:06 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:06.969353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:06.998988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd798a4d-26d1-46cb-9785-7a7bd812e932 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:07.003468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:07.004723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.004723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.004899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.006822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.087895 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:07.090198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d743f-b689-4c4a-81fd-0aa3c03012da service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:07.104993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 880/1767] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:06 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:07.120067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3518d98a43e1485d9c0a75d09a7c1121', 'request_id': 'req-af630acd-50b3-4d04-9c7c-9e55dce9f27e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.130018 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3518d98a43e1485d9c0a75d09a7c1121', 'request_id': 'req-af630acd-50b3-4d04-9c7c-9e55dce9f27e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.224074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3518d98a43e1485d9c0a75d09a7c1121', 'request_id': 'req-af630acd-50b3-4d04-9c7c-9e55dce9f27e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.238874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] The token cache is being invalidate because project 3518d98a43e1485d9c0a75d09a7c1121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:07.239413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.241087 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-af630acd-50b3-4d04-9c7c-9e55dce9f27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.243931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 888/1768] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:06 2021] DELETE /identity/v3/projects/3518d98a43e1485d9c0a75d09a7c1121 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:07.249404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.249977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.250523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.271338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:07.272751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.350620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 881/1769] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:07.392845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.392845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.392845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.413105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:07.414099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:07.414381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.415970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.443321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78729937-34b5-490d-8317-b1e428a9fbc1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:07.453219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 889/1770] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:07.455081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:07.456482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:07.457382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.462206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.462542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] PATH_INFO: `/v3/users/606b5b4b36f24fa3b58355f99b23af05` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.465590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606b5b4b36f24fa3b58355f99b23af05)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:07.468317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86af7d3-fc36-4e50-a4cf-ba43577e213f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:07.470507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:07.478760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:07.480599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.480899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.481214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.482404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:07.482760 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:07.484875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:07.510781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 890/1771] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:07.518335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:07.532512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0db31-b0a2-4ae1-8f22-7b3e620b2c04 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:07.552136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:07.552826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.553122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.553406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.554779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:07.556816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:07.702818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 891/1772] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:07 2021] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:07.706889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:07.731578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606b5b4b36f24fa3b58355f99b23af05'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.744314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606b5b4b36f24fa3b58355f99b23af05'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.768420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260fdb20-1eb0-4da6-b7d0-17fd7023fac7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:07.773066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:07.773791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.774073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.774347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.775067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:07.777601 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:07.860594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606b5b4b36f24fa3b58355f99b23af05'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.868007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606b5b4b36f24fa3b58355f99b23af05'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.868643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8123581e-e419-4a3f-b689-5702857fa0b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606b5b4b36f24fa3b58355f99b23af05'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:07.874418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 882/1773] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:07 2021] DELETE /identity/v3/users/606b5b4b36f24fa3b58355f99b23af05 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:07.878609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.878921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.879195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.896470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 892/1774] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:07 2021] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:07.896900 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:07.898172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.902477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:07.904822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.917827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9bc5-6af7-493c-b105-4586fd7a53b3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:07.978145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 883/1775] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:07.989149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:07.991282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:07.992129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:07.992642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:07.992925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:07.993199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:07.995981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:07.998652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.014666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 893/1776] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:07 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:08.019952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.034309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e00026-7b8c-49a2-a97e-c412ab19668f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.055793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.056554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.056846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.057141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.058375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.062683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.077062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 894/1777] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:08 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:08.081834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.101039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84eb0-92c2-499e-b102-d3415fdfa4bf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.107324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.109023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.109718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.110237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] PATH_INFO: `/v3/projects/a2791585e65846adacc92f3ba0737301/users/e0ce9ae85fe34ee99b25ae3ac7ba6f2f/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.111999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c15d9-15fc-4330-bbb4-c72995480aef None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.117276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b9e3-e817-4d17-b475-4b62ae24d5a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.117944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b9e3-e817-4d17-b475-4b62ae24d5a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.118227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b9e3-e817-4d17-b475-4b62ae24d5a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.118504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b9e3-e817-4d17-b475-4b62ae24d5a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.128445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2791585e65846adacc92f3ba0737301, user_id=e0ce9ae85fe34ee99b25ae3ac7ba6f2f, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.128567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b9e3-e817-4d17-b475-4b62ae24d5a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.129983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b9e3-e817-4d17-b475-4b62ae24d5a3 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.131324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.141303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 884/1778] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:08.230105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 895/1779] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:08 2021] PUT /identity/v3/projects/a2791585e65846adacc92f3ba0737301/users/e0ce9ae85fe34ee99b25ae3ac7ba6f2f/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:08.240927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.241233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.241497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.271542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] MFA Rules not processed for user `e0ce9ae85fe34ee99b25ae3ac7ba6f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:08.271771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:08.345321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 885/1780] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:08 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:08.353202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.432684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f2fde-2cec-4bc3-9860-a4d7abccb72e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.437748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.438543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.438949 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.439226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.439923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.441869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.562090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 896/1781] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:08 2021] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:08.565850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.576764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647f4b4-5be3-4e99-8906-0b66f38419c2 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.617576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.619590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:08.639282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.639963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.640249 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.640526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.641239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.643200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.708766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1d79c-5e1d-4e7a-98d5-e6ae95923bc9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.714116 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.715040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.715349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.715624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] PATH_INFO: `/v3/projects/c42ae5b8749c49578d4ba664d426c9ae` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.716815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42ae5b8749c49578d4ba664d426c9ae)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.718971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.761341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 886/1782] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:08 2021] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:08.765198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.777973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53bff4-ee9f-43bc-9922-081a19b0ee67 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.783682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.784555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.785008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.785421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.786464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.792330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.808745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 887/1783] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:08 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:08.819586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.832091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3457e-6956-416a-b1a2-c42fda086bdc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:08.843002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42ae5b8749c49578d4ba664d426c9ae', 'request_id': 'req-576c3199-6d4e-44ea-b387-a2e672127a47'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:08.850970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42ae5b8749c49578d4ba664d426c9ae', 'request_id': 'req-576c3199-6d4e-44ea-b387-a2e672127a47'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:08.909981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:08.911087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:08.911426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:08.916621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] PATH_INFO: `/v3/projects/7c3e29d87c8543449e68d62ccb3e2d27/users/da620f86b0384309bae58e5fa1d58053/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:08.928580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3e29d87c8543449e68d62ccb3e2d27, user_id=da620f86b0384309bae58e5fa1d58053, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:08.931388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:08.960459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42ae5b8749c49578d4ba664d426c9ae', 'request_id': 'req-576c3199-6d4e-44ea-b387-a2e672127a47'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:08.972774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] The token cache is being invalidate because project c42ae5b8749c49578d4ba664d426c9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:08.973251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:08.974170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:08.979439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 897/1784] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:08 2021] DELETE /identity/v3/projects/c42ae5b8749c49578d4ba664d426c9ae => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:08.980893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:08.982450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:08.997030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c3199-6d4e-44ea-b387-a2e672127a47 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:09.001997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:09.002920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:09.003205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:09.003757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] PATH_INFO: `/v3/users/71d8753bc4df4def8dc32e5fee5c4a54` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:09.005094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d8753bc4df4def8dc32e5fee5c4a54)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:09.007072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:09.061788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 888/1785] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:08 2021] PUT /identity/v3/projects/7c3e29d87c8543449e68d62ccb3e2d27/users/da620f86b0384309bae58e5fa1d58053/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:09.063624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:09.065716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:09.152278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c08a93-bfe0-4968-b7b4-b12bc01d3848 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:09.159409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:09.160342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:09.160630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:09.160906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:09.161644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:09.163464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:09.175335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 889/1786] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:09 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:09.176322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:09.178205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:09.245553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c375d3e-2691-435e-aebf-965f56776b58 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:09.249707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:09.250892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:09.252975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:09.253321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:09.255460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:09.274662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d8753bc4df4def8dc32e5fee5c4a54'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:09.293322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d8753bc4df4def8dc32e5fee5c4a54'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:09.312090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d8753bc4df4def8dc32e5fee5c4a54'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:09.347992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:09.349604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:09.365284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 890/1787] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:09 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:09.365284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:09.373343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848fc96e-7072-436d-8538-6fc72c664ff3 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:09.382132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3d6f9-5316-42b2-a379-0a5e4f553491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:09.383143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d6f9-5316-42b2-a379-0a5e4f553491 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:09.389659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d6f9-5316-42b2-a379-0a5e4f553491 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:09.389659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d6f9-5316-42b2-a379-0a5e4f553491 admin admin] PATH_INFO: `/v3/projects/7c3e29d87c8543449e68d62ccb3e2d27/users/da620f86b0384309bae58e5fa1d58053/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:09.389659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3d6f9-5316-42b2-a379-0a5e4f553491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3e29d87c8543449e68d62ccb3e2d27, user_id=da620f86b0384309bae58e5fa1d58053, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:09.389659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3d6f9-5316-42b2-a379-0a5e4f553491 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:09.405438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 891/1788] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:09 2021] PUT /identity/v3/projects/7c3e29d87c8543449e68d62ccb3e2d27/users/da620f86b0384309bae58e5fa1d58053/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:09.416414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:09.418473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:09.418473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:09.458248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] MFA Rules not processed for user `da620f86b0384309bae58e5fa1d58053`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:09.460087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:09.489928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d8753bc4df4def8dc32e5fee5c4a54'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:09.491156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d8753bc4df4def8dc32e5fee5c4a54'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:09.506564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 898/1789] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:08 2021] DELETE /identity/v3/users/71d8753bc4df4def8dc32e5fee5c4a54 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:09.588906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 892/1790] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:09 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:09.592788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:09.597471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:09.692456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126d92-5944-4e6f-aae4-c9b43f47bed4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:09.698312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:09.699237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:09.699526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:09.699808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] PATH_INFO: `/v3/users/e0ce9ae85fe34ee99b25ae3ac7ba6f2f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:09.701323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ce9ae85fe34ee99b25ae3ac7ba6f2f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:09.703330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:09.977793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ce9ae85fe34ee99b25ae3ac7ba6f2f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.016484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ce9ae85fe34ee99b25ae3ac7ba6f2f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.025176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ce9ae85fe34ee99b25ae3ac7ba6f2f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.115305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ce9ae85fe34ee99b25ae3ac7ba6f2f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.116654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f252329c-7eb0-4521-9296-13d0f3f7bcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ce9ae85fe34ee99b25ae3ac7ba6f2f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.122849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:10.124779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:10.126098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 899/1791] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:09 2021] DELETE /identity/v3/users/e0ce9ae85fe34ee99b25ae3ac7ba6f2f => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:10.130032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.130433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.130839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.162632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:10.164300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:10.217154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fca08d-870b-49b6-85a3-0a9857b45e4b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:10.252687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 900/1792] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:10.262511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:10.267741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:10.284809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:10.285688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.285969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.286332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] PATH_INFO: `/v3/projects/9d524280fe3444fbafd53f02768e6a5c` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.287669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d524280fe3444fbafd53f02768e6a5c)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:10.289657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:10.327844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100950c-ef0a-4639-a27d-54e129c1b567 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:10.331680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc001f-45c2-4304-8f79-a221fbe83d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:10.332440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc001f-45c2-4304-8f79-a221fbe83d05 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.332826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc001f-45c2-4304-8f79-a221fbe83d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.333197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc001f-45c2-4304-8f79-a221fbe83d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.342898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc001f-45c2-4304-8f79-a221fbe83d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:10.345012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc001f-45c2-4304-8f79-a221fbe83d05 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:10.366753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 901/1793] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:16:10.457742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d524280fe3444fbafd53f02768e6a5c', 'request_id': 'req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.465736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d524280fe3444fbafd53f02768e6a5c', 'request_id': 'req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.668172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d524280fe3444fbafd53f02768e6a5c', 'request_id': 'req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.681567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] The token cache is being invalidate because project 9d524280fe3444fbafd53f02768e6a5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:10.681872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.683259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-dcd80bc6-9b27-4f66-ad4f-cb4dd71a8fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:10.688868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 893/1794] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:10 2021] DELETE /identity/v3/projects/9d524280fe3444fbafd53f02768e6a5c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:10.691152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.691624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.691758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.714748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:10.716179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:10.781825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 902/1795] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:10.790842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.791134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.791438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.814142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:10.815429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:10.841147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 894/1796] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:10.845580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:10.859779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49435c-e3c4-4729-b23d-08504979a72d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:10.865770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:10.867176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.867557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.867926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.868763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:10.869187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:10.871812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:10.885174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 903/1797] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:10.889477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:10.898811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe8aa3-b906-4654-a99d-6258461994e1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:10.903526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:10.904497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:10.904497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:10.904716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:10.905413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:10.907378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.049324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 895/1798] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:10 2021] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:11.054462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.069480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd7385-deb1-4ea9-a7d5-b791c0986ad4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.161477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.162437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.162775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.163050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.163764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.165702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.183976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.183976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:11.195101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f642-d95a-4c5c-b79a-30ab76089ced admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.200598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.201415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.201697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.201973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] PATH_INFO: `/v3/projects/a2791585e65846adacc92f3ba0737301` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.203201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2791585e65846adacc92f3ba0737301)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.205309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.310657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 904/1799] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:11 2021] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:11.311877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.321864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42673a-858d-4821-aad7-d678f20231d5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.327094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.327766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.328046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.328317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.329388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.330756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.341075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 905/1800] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:11.345057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.354889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebdfc-b555-4857-b158-a2946a284c26 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.359895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.360517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.361050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.361324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.362016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.363584 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.373654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 906/1801] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:11.377534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.387311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0d816-1428-43e2-9220-3bdb95a72616 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.399503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2791585e65846adacc92f3ba0737301', 'request_id': 'req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:11.407245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2791585e65846adacc92f3ba0737301', 'request_id': 'req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:11.441153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab935c8-7c31-49ba-870e-aa1c577b7831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.442045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab935c8-7c31-49ba-870e-aa1c577b7831 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.442327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab935c8-7c31-49ba-870e-aa1c577b7831 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.442627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab935c8-7c31-49ba-870e-aa1c577b7831 admin admin] PATH_INFO: `/v3/projects/3139324193ac407ea292af7376737b6f/users/572a9eb911af48278b90e45af7569ec5/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.456919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab935c8-7c31-49ba-870e-aa1c577b7831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3139324193ac407ea292af7376737b6f, user_id=572a9eb911af48278b90e45af7569ec5, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.459606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab935c8-7c31-49ba-870e-aa1c577b7831 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.653039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2791585e65846adacc92f3ba0737301', 'request_id': 'req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:11.658856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 907/1802] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:11 2021] PUT /identity/v3/projects/3139324193ac407ea292af7376737b6f/users/572a9eb911af48278b90e45af7569ec5/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:11.669470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.669752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.670025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.680934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] The token cache is being invalidate because project a2791585e65846adacc92f3ba0737301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:11.681267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:11.684914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:11.689415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 896/1803] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:11 2021] DELETE /identity/v3/projects/a2791585e65846adacc92f3ba0737301 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:11.696847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.698736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:11.703159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] MFA Rules not processed for user `572a9eb911af48278b90e45af7569ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:11.704996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:11.712192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d2e4-438c-4cf5-ba18-c7bc771dadf9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.782772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 908/1804] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:11 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:11.787834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:11.789158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:11.794635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.795773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.796161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.796539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] PATH_INFO: `/v3/users/da620f86b0384309bae58e5fa1d58053` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.797833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da620f86b0384309bae58e5fa1d58053)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.800024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.804508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03585aa-20d8-423a-be40-43b78ac99805 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:11.810428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:11.811133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:11.811470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:11.811806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:11.816411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:11.816411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:11.938847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 909/1805] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:11 2021] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:11.941020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.016395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d0894-3771-46ce-8013-8c0b3f5fed13 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.022763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.023440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.023719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.023991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.024686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.027398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.053668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da620f86b0384309bae58e5fa1d58053'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:12.067513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da620f86b0384309bae58e5fa1d58053'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:12.144304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 910/1806] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:11 2021] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:12.144441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da620f86b0384309bae58e5fa1d58053'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:12.147555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.154916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da620f86b0384309bae58e5fa1d58053'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:12.157864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da620f86b0384309bae58e5fa1d58053'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:12.166180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891053f-cee0-4709-b65b-c0f24916c291 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.170045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 897/1807] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:11 2021] DELETE /identity/v3/users/da620f86b0384309bae58e5fa1d58053 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:12.287189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.288006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.288201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.288944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.289315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.290968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.302616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 911/1808] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:12.306294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.308457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:12.322457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f3ff2-ae6f-4b3f-acf5-e7837e582773 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.328250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.329210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.329570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.329918 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] PATH_INFO: `/v3/projects/0d0f207d4c6845299c285e01e782dc2b/users/ca18065e08ee47e78e638b359e8145d6/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.348671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0f207d4c6845299c285e01e782dc2b, user_id=ca18065e08ee47e78e638b359e8145d6, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.352125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.542173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 898/1809] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:12 2021] PUT /identity/v3/projects/0d0f207d4c6845299c285e01e782dc2b/users/ca18065e08ee47e78e638b359e8145d6/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:12.545981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.556609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6ebea-4e71-402e-a056-2115e71666e2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.623792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e65848-6c66-4168-8cc8-2b889f6b450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.624475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65848-6c66-4168-8cc8-2b889f6b450e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.624755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65848-6c66-4168-8cc8-2b889f6b450e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.625057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e65848-6c66-4168-8cc8-2b889f6b450e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.625782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65848-6c66-4168-8cc8-2b889f6b450e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.627591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e65848-6c66-4168-8cc8-2b889f6b450e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.639246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 912/1810] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:12 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:12.643832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.654864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c1398-5484-46b1-aaca-1ce541b859e3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.660555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.661930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.663228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.663750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] PATH_INFO: `/v3/projects/0d0f207d4c6845299c285e01e782dc2b/users/ca18065e08ee47e78e638b359e8145d6/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.666661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0f207d4c6845299c285e01e782dc2b, user_id=ca18065e08ee47e78e638b359e8145d6, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.678561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.683093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 899/1811] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:12 2021] PUT /identity/v3/projects/0d0f207d4c6845299c285e01e782dc2b/users/ca18065e08ee47e78e638b359e8145d6/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:12.692914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.693287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.693629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.737841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] MFA Rules not processed for user `ca18065e08ee47e78e638b359e8145d6`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:12.739035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:12.806603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 913/1812] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:12 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:12.820772 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.825648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:12.825829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:12.827371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:12.902682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab39b49-ff78-4ed3-af00-b404643fcf47 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.907034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.907691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.907978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.908235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.910016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:12.922063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cb1dda-e406-4772-8008-713177d09f03 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:12.930099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:12.936893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:12.936893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:12.936893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] PATH_INFO: `/v3/projects/7c3e29d87c8543449e68d62ccb3e2d27` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:12.936893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3e29d87c8543449e68d62ccb3e2d27)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.936893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.971415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:12.972998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157c5ee-152f-4c2f-9413-6bd942d74f48 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:12.984381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 900/1813] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:12 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:13.080316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3e29d87c8543449e68d62ccb3e2d27', 'request_id': 'req-bfc33ebc-db85-4950-94be-0388131e4eb2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:13.111257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3e29d87c8543449e68d62ccb3e2d27', 'request_id': 'req-bfc33ebc-db85-4950-94be-0388131e4eb2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:13.186917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3e29d87c8543449e68d62ccb3e2d27', 'request_id': 'req-bfc33ebc-db85-4950-94be-0388131e4eb2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:13.200859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] The token cache is being invalidate because project 7c3e29d87c8543449e68d62ccb3e2d27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:13.201352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:13.202645 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-bfc33ebc-db85-4950-94be-0388131e4eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:13.213260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.215213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.215213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.217063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 914/1814] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:12 2021] DELETE /identity/v3/projects/7c3e29d87c8543449e68d62ccb3e2d27 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:13.233494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:13.234730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:13.306442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 901/1815] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:13.314080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.314614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.314986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.334630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:13.336017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:13.344776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 915/1816] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:13.348941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:13.363565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5240f3a-66b3-42f7-a4ef-2d911b44e77a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:13.374253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:13.375132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.375415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.375837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.378870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:13.378870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:13.378870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:13.402003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 902/1817] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:13.406258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:13.417485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc289d-1483-4dc2-87f6-fa4c191a5b55 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:13.426343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:13.427861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.428217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.434348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.434348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:13.434348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:13.630409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 916/1818] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:13 2021] POST /identity/v3/projects => generated 355 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:13.634689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:13.645209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8249e-b33a-4b44-b6bf-de02693d1d6e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:13.769915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:13.770856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.773456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.773456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.773456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:13.775163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:13.867234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 903/1819] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:13 2021] POST /identity/v3/users => generated 278 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:13.871547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:13.892483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7d716-b7a9-48ea-8303-04522e1d5ec9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:13.905642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:13.906473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.906791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.907065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.907845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:13.912380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:13.934619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 917/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:13.935812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:13.959763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ae7b6-6344-4a88-955a-fe7fe17e6472 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:13.974934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693d61-4b3e-41c4-8b74-d20ada8fa4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:13.975762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693d61-4b3e-41c4-8b74-d20ada8fa4df admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:13.976070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693d61-4b3e-41c4-8b74-d20ada8fa4df admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:13.976393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693d61-4b3e-41c4-8b74-d20ada8fa4df admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:13.977101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29693d61-4b3e-41c4-8b74-d20ada8fa4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:13.979901 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29693d61-4b3e-41c4-8b74-d20ada8fa4df admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.007472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 904/1821] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:13 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:14.008656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:14.025287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf092cf5-57e3-4ec6-8967-7f6aa21bbc8c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:14.051065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:14.053955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.055452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.057485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] PATH_INFO: `/v3/projects/6baf9844ab1f48288b5b074cbe65cf86/users/569faca969b244bc9cfefe1680ad20f2/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.097960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6baf9844ab1f48288b5b074cbe65cf86, user_id=569faca969b244bc9cfefe1680ad20f2, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:14.101759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.205912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 918/1822] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:14 2021] PUT /identity/v3/projects/6baf9844ab1f48288b5b074cbe65cf86/users/569faca969b244bc9cfefe1680ad20f2/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:14.222714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.222714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.223151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.258044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] MFA Rules not processed for user `569faca969b244bc9cfefe1680ad20f2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:14.260260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:14.335154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 905/1823] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:14 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:14.340048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:14.412602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20f303-17a7-4848-a61e-8a9dc7547c1e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:14.419208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:14.419912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.420621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.420951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.421688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:14.423697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.564208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 919/1824] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:14 2021] POST /identity/v3/projects => generated 357 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:14.567860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:14.583284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ed4d7-11e8-4870-9f72-083419a0471e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:14.652801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:14.653829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.654119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.654570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.655466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:14.657966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.743754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 906/1825] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:14 2021] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:14.750912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:14.761312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff394d-76d1-4de4-99f6-93056222c110 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:14.766351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:14.767009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.767295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.767592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.768312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:14.769924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.781056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 920/1826] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:14.785443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:14.795749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d6844-277f-4de1-9434-48e2aa28c04b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:14.800457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:14.801286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.801569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.801843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] PATH_INFO: `/v3/projects/06b55b698b7f4b518d85ab060cbb1d0a/users/7afde94fca0c4a998451c445080cf0c4/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.816569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b55b698b7f4b518d85ab060cbb1d0a, user_id=7afde94fca0c4a998451c445080cf0c4, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:14.819288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.890244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 907/1827] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:14 2021] PUT /identity/v3/projects/06b55b698b7f4b518d85ab060cbb1d0a/users/7afde94fca0c4a998451c445080cf0c4/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:14.894139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:14.905861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bd0f3-adeb-4e63-8878-4f463b1e2e3c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:14.965756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197c868-3b0d-4c63-9cd7-36a1dafc53a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:14.966435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197c868-3b0d-4c63-9cd7-36a1dafc53a2 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:14.966795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197c868-3b0d-4c63-9cd7-36a1dafc53a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:14.967068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197c868-3b0d-4c63-9cd7-36a1dafc53a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:14.967788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197c868-3b0d-4c63-9cd7-36a1dafc53a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:14.969416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197c868-3b0d-4c63-9cd7-36a1dafc53a2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:14.988272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 921/1828] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:14 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:14.992318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:15.004548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b77a3-3169-4a44-a36f-3920e1fe771a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:15.013043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:15.013960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:15.014233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:15.014506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] PATH_INFO: `/v3/projects/06b55b698b7f4b518d85ab060cbb1d0a/users/7afde94fca0c4a998451c445080cf0c4/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:15.016683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b55b698b7f4b518d85ab060cbb1d0a, user_id=7afde94fca0c4a998451c445080cf0c4, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:15.019582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:15.033811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 908/1829] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:14 2021] PUT /identity/v3/projects/06b55b698b7f4b518d85ab060cbb1d0a/users/7afde94fca0c4a998451c445080cf0c4/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:15.045407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:15.045702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:15.045988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:15.089182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] MFA Rules not processed for user `7afde94fca0c4a998451c445080cf0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:15.089182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:15.194168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 922/1830] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:15 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:15.276573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:15.278272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:15.336821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bd168-4079-4981-b7fd-c2f0aabe2bf8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:15.355250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:15.355932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:15.356212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:15.356487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:15.378946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:15.380627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:15.391854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 909/1831] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:15 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:15.781882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:15.783580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:15.819442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e57ef-3830-428d-ae69-5e0bfb9e9af2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:15.823907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695638-dbb1-49e3-8933-46b68e57c841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:15.824577 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695638-dbb1-49e3-8933-46b68e57c841 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:15.824851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695638-dbb1-49e3-8933-46b68e57c841 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:15.825127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695638-dbb1-49e3-8933-46b68e57c841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:15.901041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695638-dbb1-49e3-8933-46b68e57c841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:15.903799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695638-dbb1-49e3-8933-46b68e57c841 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:15.914623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 923/1832] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:15 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:16.875119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:16.877607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:16.955243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ac562-b416-41c9-8d04-a5058b2fb8fc service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:16.960207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:16.961100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:16.961514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:16.961793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] PATH_INFO: `/v3/users/572a9eb911af48278b90e45af7569ec5` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:16.963052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=572a9eb911af48278b90e45af7569ec5)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:16.965498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:17.230110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572a9eb911af48278b90e45af7569ec5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:17.242092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572a9eb911af48278b90e45af7569ec5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:17.309167 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572a9eb911af48278b90e45af7569ec5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:17.317648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572a9eb911af48278b90e45af7569ec5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:17.318511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572a9eb911af48278b90e45af7569ec5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:17.328268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 910/1833] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:16 2021] DELETE /identity/v3/users/572a9eb911af48278b90e45af7569ec5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:17.330063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:17.330503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:17.330977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:17.348449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:17.349688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:17.410697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 924/1834] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:17.421089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:17.422696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:17.483782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8b67-a0ea-49af-9e57-d39e11acb051 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:17.483782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:17.484337 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:17.484620 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:17.484892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:17.494785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:17.496819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:17.506469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 911/1835] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:17.988883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:17.990315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:18.001803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12c0f-3efb-4f67-b4f6-82413cb04fec None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:18.006344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:18.007232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:18.007514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:18.007785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] PATH_INFO: `/v3/projects/3139324193ac407ea292af7376737b6f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:18.008968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3139324193ac407ea292af7376737b6f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:18.010895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:18.129035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3139324193ac407ea292af7376737b6f', 'request_id': 'req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.136974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3139324193ac407ea292af7376737b6f', 'request_id': 'req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.219452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3139324193ac407ea292af7376737b6f', 'request_id': 'req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.237273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] The token cache is being invalidate because project 3139324193ac407ea292af7376737b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:18.237780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.238650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.240292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 925/1836] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:17 2021] DELETE /identity/v3/projects/3139324193ac407ea292af7376737b6f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:18.245140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:18.258215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96255483-91e5-4449-aeab-7665eab07af8 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:18.321194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:18.322131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:18.329357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:18.329357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] PATH_INFO: `/v3/users/ca18065e08ee47e78e638b359e8145d6` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:18.329357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca18065e08ee47e78e638b359e8145d6)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:18.329357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:18.603295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca18065e08ee47e78e638b359e8145d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.616447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca18065e08ee47e78e638b359e8145d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.743509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca18065e08ee47e78e638b359e8145d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.753706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca18065e08ee47e78e638b359e8145d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.754917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3bcbb8b9-ec03-407f-bf8c-e9a3eeccba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca18065e08ee47e78e638b359e8145d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:18.762980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 912/1837] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:18 2021] DELETE /identity/v3/users/ca18065e08ee47e78e638b359e8145d6 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:19.231791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:19.232690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:19.253202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38ec1a-929a-48e8-a4b2-2bbd5bca6af5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:19.330525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:19.332629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:19.332914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:19.333243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] PATH_INFO: `/v3/projects/0d0f207d4c6845299c285e01e782dc2b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:19.334965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0f207d4c6845299c285e01e782dc2b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:19.337358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:19.489626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0f207d4c6845299c285e01e782dc2b', 'request_id': 'req-c3b11877-e052-4f65-b193-5c0bc78bd470'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:19.499084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0f207d4c6845299c285e01e782dc2b', 'request_id': 'req-c3b11877-e052-4f65-b193-5c0bc78bd470'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:19.583245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0f207d4c6845299c285e01e782dc2b', 'request_id': 'req-c3b11877-e052-4f65-b193-5c0bc78bd470'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:19.595199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] The token cache is being invalidate because project 0d0f207d4c6845299c285e01e782dc2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:19.595658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:19.596291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c3b11877-e052-4f65-b193-5c0bc78bd470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:19.597855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 926/1838] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:19 2021] DELETE /identity/v3/projects/0d0f207d4c6845299c285e01e782dc2b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:19.604096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:19.604693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:19.604693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:19.624054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:19.625263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:19.685832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 913/1839] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:19.695110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:19.695441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:19.695991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:19.715447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:19.716835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:19.724932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 927/1840] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:19.729028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:19.739195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d1abdb-8650-465c-9441-b424a9c6ef36 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:19.743836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:19.744501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:19.744937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:19.745209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:19.745937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:19.746248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:19.747891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:19.759329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 914/1841] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:19.764241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:19.776617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8af89-1605-4fac-a06e-f6ce61f3e2a1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:19.778837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:19.779478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:19.779765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:19.780041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:19.780730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:19.782686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:19.890328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 928/1842] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:19 2021] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:19.892116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:19.910328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c97002c-a0c9-400e-aa77-50abc9e44ecd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:19.964248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:19.965042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:19.965445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:19.970502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:19.970502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:19.970502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.063765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 915/1843] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:19 2021] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:20.067727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.078113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3cda88-475f-49fb-a85e-5da48bf92589 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.083349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.084018 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.084344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.084626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.085349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.087026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.099257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 929/1844] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:20.103311 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.115134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7ba8d-e069-4e64-a53d-b2c82fa2b133 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.128249 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78879b73-dcb7-4258-8703-f205e2173603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.128958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78879b73-dcb7-4258-8703-f205e2173603 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.129241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78879b73-dcb7-4258-8703-f205e2173603 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.129459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78879b73-dcb7-4258-8703-f205e2173603 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.130190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78879b73-dcb7-4258-8703-f205e2173603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.131828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78879b73-dcb7-4258-8703-f205e2173603 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.145500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 916/1845] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:20.147300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.159868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a43e2-0cb3-40df-86e7-55b364a87539 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.163725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.164636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.164919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.165193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] PATH_INFO: `/v3/projects/68b813f359554adc96b968dba5805d9a/users/7c85b19ae139487db4c2ce1196902acd/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.180758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b813f359554adc96b968dba5805d9a, user_id=7c85b19ae139487db4c2ce1196902acd, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.183671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.258953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 930/1846] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:20 2021] PUT /identity/v3/projects/68b813f359554adc96b968dba5805d9a/users/7c85b19ae139487db4c2ce1196902acd/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:20.271908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.272199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.272476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.300995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] MFA Rules not processed for user `7c85b19ae139487db4c2ce1196902acd`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:20.302173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:20.368312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 917/1847] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:20 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:20.373095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.432900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0520de-7b22-4df0-940b-956507e2c120 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.437802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.438464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.438775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.439048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.439740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.441641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.537475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 931/1848] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:20 2021] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:20.541882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.552908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9007-d40f-4a72-bd83-cb0e2e4c9d74 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.606995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.607646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.607934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.608235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.608916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.610849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.717709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 918/1849] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:20 2021] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:20.721643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.732008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bebccf5-926c-49b8-9e2a-cbf3ac6413fa admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.736953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.737612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.737898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.738207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.738960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.740623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.751678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 932/1850] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:20.755448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.765854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e77aed-372a-4470-934c-f7054ecc7c95 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.770468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811cf291-4029-404a-9cf9-0e03a288fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.771150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf291-4029-404a-9cf9-0e03a288fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.771431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf291-4029-404a-9cf9-0e03a288fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.771701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811cf291-4029-404a-9cf9-0e03a288fa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.772424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cf291-4029-404a-9cf9-0e03a288fa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.773993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811cf291-4029-404a-9cf9-0e03a288fa69 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.783488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 919/1851] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:20 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:20.787319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:20.796702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5b915-29d2-463f-9e47-abf1a2d19f55 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:20.801224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:20.802075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.802356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.802658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] PATH_INFO: `/v3/projects/d26d2f74dd3b47898fa73ac6d4a6b276/users/44226002e1ac4de3a597b72bb41ed5f4/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.816773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26d2f74dd3b47898fa73ac6d4a6b276, user_id=44226002e1ac4de3a597b72bb41ed5f4, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:20.819423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:20.914875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 933/1852] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:20 2021] PUT /identity/v3/projects/d26d2f74dd3b47898fa73ac6d4a6b276/users/44226002e1ac4de3a597b72bb41ed5f4/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:20.925781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:20.926160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:20.926527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:20.954097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] MFA Rules not processed for user `44226002e1ac4de3a597b72bb41ed5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:20.955339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:21.019453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 920/1853] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:20 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:21.023939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.082926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf3068-2699-408f-980a-8c669700cc73 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.087516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.088266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.088565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.088839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.089521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.091450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.171279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 934/1854] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:21 2021] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:21.175133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.186245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac39fe8-ad54-4503-99c0-316c5b8ef4ff None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.240000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.240603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.240883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.241156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.241840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.243766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.329783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 921/1855] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:21 2021] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:21.333820 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.344390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7785606-1bb0-4f9f-b977-84e108d4ee78 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.349192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.349704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.349988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.350262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.351076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.352675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.364579 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 935/1856] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:21.368880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.379721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c400806-8394-44b3-a5a4-965b070bec86 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.384426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.385349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.385630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.385903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] PATH_INFO: `/v3/projects/26618fc8d28740ff96e39eff2d6d223a/users/250732d820d141c3872219f1d7fc18c4/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.400023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=26618fc8d28740ff96e39eff2d6d223a, user_id=250732d820d141c3872219f1d7fc18c4, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.402721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.466404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 922/1857] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:21 2021] PUT /identity/v3/projects/26618fc8d28740ff96e39eff2d6d223a/users/250732d820d141c3872219f1d7fc18c4/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:21.470478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.481013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72278b58-eb81-4c24-8eb6-ae53f1bf499f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.534664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b363-636b-44e3-a3b9-1e1fb8cccff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.535334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b363-636b-44e3-a3b9-1e1fb8cccff0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.535614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b363-636b-44e3-a3b9-1e1fb8cccff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.535888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b363-636b-44e3-a3b9-1e1fb8cccff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.536599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b363-636b-44e3-a3b9-1e1fb8cccff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.538179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b363-636b-44e3-a3b9-1e1fb8cccff0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.547661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 936/1858] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:21.551762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.562224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554c60-1475-4e2f-b89d-ac5af1ab94ea admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.566829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.567701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.567980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.568254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] PATH_INFO: `/v3/projects/26618fc8d28740ff96e39eff2d6d223a/users/250732d820d141c3872219f1d7fc18c4/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.570189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26618fc8d28740ff96e39eff2d6d223a, user_id=250732d820d141c3872219f1d7fc18c4, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.573462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.583399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 923/1859] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:21 2021] PUT /identity/v3/projects/26618fc8d28740ff96e39eff2d6d223a/users/250732d820d141c3872219f1d7fc18c4/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:21.596090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.596380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.596700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.625617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] MFA Rules not processed for user `250732d820d141c3872219f1d7fc18c4`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:21.626884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:21.692202 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 937/1860] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:21 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:21.703164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:21.704893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:21.759788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077d02-cc1e-4d9c-8e32-274c91fa8d67 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:21.764087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:21.764753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:21.765038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:21.765315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:21.819222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:21.820659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:21.830137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 924/1861] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:27.730445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:27.745562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b5edd-a59d-43f7-8ade-c28d3da3e53c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:27.746673 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:27.747408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:27.747719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:27.748126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:27.834033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:27.835509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:27.846975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 938/1862] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:27 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:29.516230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:29.530802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b19998-f141-4764-9999-7d9bc7129c39 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:29.533794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:29.536249 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:29.536533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:29.536860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:29.549457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:29.551044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:29.561648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 925/1863] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:29 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:34.338156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:34.339786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:34.405637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacb533-d9c8-4596-931f-31b7cfd56a92 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:34.410248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:34.411162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:34.411449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:34.411729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] PATH_INFO: `/v3/users/86e7e59a8e244892b71943ab02fb757b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:34.412911 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e7e59a8e244892b71943ab02fb757b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:34.415143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:34.597562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e7e59a8e244892b71943ab02fb757b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.609353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e7e59a8e244892b71943ab02fb757b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.616666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e7e59a8e244892b71943ab02fb757b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.647814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:34.649281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:34.663270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348dac9-4104-4925-b7c0-8ac09c3efd0c service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:34.667829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:34.669158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:34.669437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:34.669713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] PATH_INFO: `/v3/users/d54df4b83622480cb64cca23a5b65eda` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:34.670923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54df4b83622480cb64cca23a5b65eda)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:34.672835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:34.703700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e7e59a8e244892b71943ab02fb757b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.704316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e7e59a8e244892b71943ab02fb757b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.710446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 939/1864] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:34 2021] DELETE /identity/v3/users/86e7e59a8e244892b71943ab02fb757b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:34.912402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54df4b83622480cb64cca23a5b65eda'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.927120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54df4b83622480cb64cca23a5b65eda'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:34.980032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:34.987366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:35.036305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54df4b83622480cb64cca23a5b65eda'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.046211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54df4b83622480cb64cca23a5b65eda'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.047066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54df4b83622480cb64cca23a5b65eda'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.055987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 926/1865] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:34 2021] DELETE /identity/v3/users/d54df4b83622480cb64cca23a5b65eda => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:35.069886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446efb2-fea1-4d15-b436-0709b1a743b1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:35.135390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:35.135390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.135390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.135390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] PATH_INFO: `/v3/projects/b33f9d01492d4123aa1ba8d2b245f093` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.135843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b33f9d01492d4123aa1ba8d2b245f093)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:35.137901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:35.287177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b33f9d01492d4123aa1ba8d2b245f093', 'request_id': 'req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.293820 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b33f9d01492d4123aa1ba8d2b245f093', 'request_id': 'req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.382518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:35.384029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:35.398483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774df65-ca4d-41c9-98b3-a9212aa7d0be admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:35.453729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:35.454645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.454932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.455206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] PATH_INFO: `/v3/projects/9418eeb2771342b99e046a1b5d9a1ea5` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.456405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9418eeb2771342b99e046a1b5d9a1ea5)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:35.458356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:35.480558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b33f9d01492d4123aa1ba8d2b245f093', 'request_id': 'req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.492090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] The token cache is being invalidate because project b33f9d01492d4123aa1ba8d2b245f093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:35.492381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.493013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.494636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 940/1866] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:34 2021] DELETE /identity/v3/projects/b33f9d01492d4123aa1ba8d2b245f093 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:35.498538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:35.499936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:35.513090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cee9e-4c8a-4c1c-9639-f1ba76ee3940 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:35.519247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:35.520421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.520738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.521018 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] PATH_INFO: `/v3/users/2e8ff804ac7e426eaf45bf9bc211376f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.522227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8ff804ac7e426eaf45bf9bc211376f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:35.524275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:35.575471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9418eeb2771342b99e046a1b5d9a1ea5', 'request_id': 'req-2439dfa1-8790-4560-abc4-3045030c2ed2'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.581547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9418eeb2771342b99e046a1b5d9a1ea5', 'request_id': 'req-2439dfa1-8790-4560-abc4-3045030c2ed2'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.649913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9418eeb2771342b99e046a1b5d9a1ea5', 'request_id': 'req-2439dfa1-8790-4560-abc4-3045030c2ed2'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.663056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] The token cache is being invalidate because project 9418eeb2771342b99e046a1b5d9a1ea5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:35.663330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.663980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-2439dfa1-8790-4560-abc4-3045030c2ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.665558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 927/1867] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:35 2021] DELETE /identity/v3/projects/9418eeb2771342b99e046a1b5d9a1ea5 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:35.673446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.673732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.674004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.694316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:35.695562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:35.721318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8ff804ac7e426eaf45bf9bc211376f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.737939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8ff804ac7e426eaf45bf9bc211376f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.755640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8ff804ac7e426eaf45bf9bc211376f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.772235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 928/1868] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:35.780442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:35.781773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:35.794625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba78711-db7f-46b0-a671-9b4d38d3abd1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:35.801515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:35.802403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.802723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.803003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] PATH_INFO: `/v3/users/7c85b19ae139487db4c2ce1196902acd` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.804259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c85b19ae139487db4c2ce1196902acd)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:35.806529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:35.832844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8ff804ac7e426eaf45bf9bc211376f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.833488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e4a5d64e-8ac1-402c-ab8a-7e2676d78a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8ff804ac7e426eaf45bf9bc211376f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:35.840711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 941/1869] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:35 2021] DELETE /identity/v3/users/2e8ff804ac7e426eaf45bf9bc211376f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:35.842541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.843062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.843572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.872477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:35.873699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:35.940306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 942/1870] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:35.945360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:35.955330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bff69-557d-4afb-af6b-52902f07144d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:35.960812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:35.961169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:35.961474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:35.961740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:35.962476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:35.963001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:35.964620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:35.977594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 943/1871] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:16:35.982489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:35.993148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b591f-a801-4e52-8173-d9d0d891967b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.005252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.007378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.007680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.007958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.008660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.010703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.017386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c85b19ae139487db4c2ce1196902acd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.040576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c85b19ae139487db4c2ce1196902acd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.132614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c85b19ae139487db4c2ce1196902acd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.141580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c85b19ae139487db4c2ce1196902acd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.141879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 944/1872] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:35 2021] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:36.142784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.143283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c85b19ae139487db4c2ce1196902acd'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.144818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.152459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 929/1873] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:35 2021] DELETE /identity/v3/users/7c85b19ae139487db4c2ce1196902acd => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:36.154190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.155644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.217805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c72bcb-bda4-4a43-b837-df2338c3cf79 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.221737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aec371-4ae6-447e-b22f-ef7e571cb65b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.222947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.223908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.224252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.224537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] PATH_INFO: `/v3/projects/fa2f0c1f38d74a25b0b08066744dee1f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.225721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2f0c1f38d74a25b0b08066744dee1f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.226631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc34145-82b9-4d54-9173-45eb63fc7f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.227304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc34145-82b9-4d54-9173-45eb63fc7f7c admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.227589 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc34145-82b9-4d54-9173-45eb63fc7f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.227745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.227846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc34145-82b9-4d54-9173-45eb63fc7f7c admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.228596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc34145-82b9-4d54-9173-45eb63fc7f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.230596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc34145-82b9-4d54-9173-45eb63fc7f7c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.344873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 930/1874] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:36.346488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.348080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.348362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.357967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2f0c1f38d74a25b0b08066744dee1f', 'request_id': 'req-d9f77679-9e25-4e64-9032-607dd0980324'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.364865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2f0c1f38d74a25b0b08066744dee1f', 'request_id': 'req-d9f77679-9e25-4e64-9032-607dd0980324'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.370316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:36.372286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.429520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 931/1875] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:36.430351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.439482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65b63f-5252-4c4b-a5e0-6c993426e404 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.444050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.444694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.444977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.445249 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.445957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.447585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.457026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 932/1876] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:36.457780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.461146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.506734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2f0c1f38d74a25b0b08066744dee1f', 'request_id': 'req-d9f77679-9e25-4e64-9032-607dd0980324'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.516018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ad71b-e957-4fbf-90cd-691b6c9a17fd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.517929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] The token cache is being invalidate because project fa2f0c1f38d74a25b0b08066744dee1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:36.518228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.518929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:36.520148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.520878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 945/1877] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:36 2021] DELETE /identity/v3/projects/fa2f0c1f38d74a25b0b08066744dee1f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:36.521420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.521546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.521944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.522397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.524307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.525964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.537279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.538765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5248f4a8-c24a-431f-a93b-da4582ecf129 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.547150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f77679-9e25-4e64-9032-607dd0980324 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.549100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 933/1878] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:36.552660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143474b2-bc29-4022-b0b8-244232a6c3db None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.552660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143474b2-bc29-4022-b0b8-244232a6c3db None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.552660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143474b2-bc29-4022-b0b8-244232a6c3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.552932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.552932 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.553118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.553257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.554062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.555740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.569305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 946/1879] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:36 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:36.570166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.570801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-143474b2-bc29-4022-b0b8-244232a6c3db None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:36.571972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-143474b2-bc29-4022-b0b8-244232a6c3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.580165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 934/1880] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:36.582497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417824e-c475-41bd-bbf4-21ebdd3e9d0d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.587784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f69eb-482b-45d5-8bd9-66e68c20bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.588685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f69eb-482b-45d5-8bd9-66e68c20bfcf admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.588945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.589051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f69eb-482b-45d5-8bd9-66e68c20bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.589221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f69eb-482b-45d5-8bd9-66e68c20bfcf admin admin] PATH_INFO: `/v3/projects/d6dca98381184646932bd2af4571e211/users/6fc058dc8d2b4f54811a8632d9095e9c/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.589315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.589496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.608683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f69eb-482b-45d5-8bd9-66e68c20bfcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6dca98381184646932bd2af4571e211, user_id=6fc058dc8d2b4f54811a8632d9095e9c, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.613196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:36.613304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f69eb-482b-45d5-8bd9-66e68c20bfcf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.613382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.621131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 935/1881] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:36.625416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.634352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4d281-14cf-4dfd-abcb-02afe03b1c87 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.639063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.644254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.644254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.644254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.644254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:36.644254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.644254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.655563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 936/1882] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:36.659760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.669992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585f5ae-75aa-4e0b-873a-e7c4f511c5f5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.674638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.676226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.676226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.676226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.676591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.678485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.707547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 947/1883] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:36 2021] PUT /identity/v3/projects/d6dca98381184646932bd2af4571e211/users/6fc058dc8d2b4f54811a8632d9095e9c/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:36.750935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.751223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.751507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.782468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] MFA Rules not processed for user `6fc058dc8d2b4f54811a8632d9095e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:36.784522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.792653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 937/1884] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:36.797378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.870763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 948/1885] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:36.883805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:36.886039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:36.896040 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d769c-51dd-40ad-8d48-9c8bac72a524 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:36.904933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:36.910907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:36.910907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:36.910907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:36.910907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:36.926063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:36.983194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbf940-e167-43d9-84d7-c100c3277b60 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.041930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 938/1886] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:36 2021] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:37.042923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.045417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.051158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.051818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.052123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.052420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.057312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d70fff-6eac-4cee-9665-954b3ce6c017 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.062710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.063559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.063839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.064134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] PATH_INFO: `/v3/projects/68b813f359554adc96b968dba5805d9a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.065315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b813f359554adc96b968dba5805d9a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.067262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.108135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.110358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.119824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 949/1887] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:36 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:37.122408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.134880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2473703e-900a-4d52-914f-eabdf18db6df service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.140447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.141258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.141587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.141872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.142755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.150728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.156093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 950/1888] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:37.159977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.178041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf50bb-3150-4808-bf2d-877095625630 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.205828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b813f359554adc96b968dba5805d9a', 'request_id': 'req-790c077a-a923-4ee0-92dd-0371c736c86a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.210666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b813f359554adc96b968dba5805d9a', 'request_id': 'req-790c077a-a923-4ee0-92dd-0371c736c86a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.255502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.256317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.256695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.256991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.257725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.260089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.273709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 951/1889] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:37 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:37.276336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.281738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b813f359554adc96b968dba5805d9a', 'request_id': 'req-790c077a-a923-4ee0-92dd-0371c736c86a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.291137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751d8b0-60a6-4a8c-a946-9bc3249e0d9f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.294639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] The token cache is being invalidate because project 68b813f359554adc96b968dba5805d9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:37.294979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.295588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.297999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.298996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.299279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.299557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] PATH_INFO: `/v3/projects/1cbc77b8f4eb41afb32c858b81d974df/users/1e7e7806f4144a0d85dae91110c820c9/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.301852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 939/1890] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:37 2021] DELETE /identity/v3/projects/68b813f359554adc96b968dba5805d9a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:37.307504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.309699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.316987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cbc77b8f4eb41afb32c858b81d974df, user_id=1e7e7806f4144a0d85dae91110c820c9, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.320458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.327653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c077a-a923-4ee0-92dd-0371c736c86a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.333501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.334379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.334744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.335022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] PATH_INFO: `/v3/users/44226002e1ac4de3a597b72bb41ed5f4` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.336274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44226002e1ac4de3a597b72bb41ed5f4)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.339712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.407903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 952/1891] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:37 2021] PUT /identity/v3/projects/1cbc77b8f4eb41afb32c858b81d974df/users/1e7e7806f4144a0d85dae91110c820c9/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:37.409005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.410695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.472544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2bbbe5-9ff0-4d7f-84d3-89ea32a41ac0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.477305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.478172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.478454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.478751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] PATH_INFO: `/v3/users/6fc058dc8d2b4f54811a8632d9095e9c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.479954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc058dc8d2b4f54811a8632d9095e9c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.482419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.628646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44226002e1ac4de3a597b72bb41ed5f4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.639806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44226002e1ac4de3a597b72bb41ed5f4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.658569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc058dc8d2b4f54811a8632d9095e9c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.671754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc058dc8d2b4f54811a8632d9095e9c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.678376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc058dc8d2b4f54811a8632d9095e9c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.724606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44226002e1ac4de3a597b72bb41ed5f4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.732785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44226002e1ac4de3a597b72bb41ed5f4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.733452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3693a653-53f8-4246-9c27-c18f2d4992f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44226002e1ac4de3a597b72bb41ed5f4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.739669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 940/1892] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:37 2021] DELETE /identity/v3/users/44226002e1ac4de3a597b72bb41ed5f4 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:37.741063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.741352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.741624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.767970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] MFA Rules not processed for user `1e7e7806f4144a0d85dae91110c820c9`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:37.769169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.778753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc058dc8d2b4f54811a8632d9095e9c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.779736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-82fab6d6-5b2b-485b-bb31-a0bbc48acfd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc058dc8d2b4f54811a8632d9095e9c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:37.789945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 953/1893] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:37 2021] DELETE /identity/v3/users/6fc058dc8d2b4f54811a8632d9095e9c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:37.803938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.804314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.804593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.823488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:37.824922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.837575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 941/1894] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:37 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:37.849610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.851367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.885872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 954/1895] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:37.895641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:37.896999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:37.909553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2590619-b70f-4b8b-aa4e-98c7d3dc61b4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.951870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6532701-b2e9-45c5-a99d-faf7b4708c59 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:37.958028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.958722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.959007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.959283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.965848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:37.965848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:37.965848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:37.965848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:37.971033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:37.972532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:37.986329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 955/1896] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:16:38.048083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:38.051546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:38.067788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 942/1897] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:37 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:16:38.093112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:38.094545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:38.111862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea774ac-afd5-4d17-8de8-641e5db4fc1c service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:38.118026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:38.119851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:38.120247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:38.120633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] PATH_INFO: `/v3/users/1e7e7806f4144a0d85dae91110c820c9` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:38.122621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7e7806f4144a0d85dae91110c820c9)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:38.124823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:38.283468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:38.285024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:38.302923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43371ee-9c1a-4aa2-b26f-183e5838c5f6 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:38.314427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:38.315342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:38.315626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:38.315902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] PATH_INFO: `/v3/projects/d26d2f74dd3b47898fa73ac6d4a6b276` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:38.317346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26d2f74dd3b47898fa73ac6d4a6b276)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:38.319801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:38.391920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7e7806f4144a0d85dae91110c820c9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.409903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7e7806f4144a0d85dae91110c820c9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.417055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7e7806f4144a0d85dae91110c820c9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.518522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7e7806f4144a0d85dae91110c820c9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.519175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7e7806f4144a0d85dae91110c820c9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.524122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26d2f74dd3b47898fa73ac6d4a6b276', 'request_id': 'req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.533260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 956/1898] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:38 2021] DELETE /identity/v3/users/1e7e7806f4144a0d85dae91110c820c9 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:38.534149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:38.535603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:38.540497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26d2f74dd3b47898fa73ac6d4a6b276', 'request_id': 'req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.587481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26d2f74dd3b47898fa73ac6d4a6b276', 'request_id': 'req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.600041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] The token cache is being invalidate because project d26d2f74dd3b47898fa73ac6d4a6b276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:38.600447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.601096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e2f3fbc1-2a04-410f-9e55-086b1fcb3f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.602744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 943/1899] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:38 2021] DELETE /identity/v3/projects/d26d2f74dd3b47898fa73ac6d4a6b276 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:38.604157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:38.604455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:38.604737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:38.624063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:38.625313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:38.686921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 944/1900] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:38.688051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:38.689652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:38.703370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682fbc5-1ad2-4547-9c35-53b4c2fd824e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:38.708515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:38.709514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:38.709801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:38.710073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] PATH_INFO: `/v3/users/250732d820d141c3872219f1d7fc18c4` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:38.711312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] RBAC: Authorizing `identity:delete_user(user_id=250732d820d141c3872219f1d7fc18c4)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:38.713236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:38.720385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fca0d-819a-4d11-b736-f551524a7f22 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:38.725229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:38.726095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:38.726404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:38.726719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] PATH_INFO: `/v3/projects/d6dca98381184646932bd2af4571e211` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:38.727911 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6dca98381184646932bd2af4571e211)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:38.729928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:38.897526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '250732d820d141c3872219f1d7fc18c4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.898086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6dca98381184646932bd2af4571e211', 'request_id': 'req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.904190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6dca98381184646932bd2af4571e211', 'request_id': 'req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.909318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '250732d820d141c3872219f1d7fc18c4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.983296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6dca98381184646932bd2af4571e211', 'request_id': 'req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.994022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] The token cache is being invalidate because project d6dca98381184646932bd2af4571e211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:38.994305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.994968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:38.997010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 957/1901] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:38 2021] DELETE /identity/v3/projects/d6dca98381184646932bd2af4571e211 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:38.997757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:38.999078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.051917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee6fb-e02e-4a14-aec5-4e638f5cda3c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.055707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.056346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.056656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.056927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.059296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.063798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '250732d820d141c3872219f1d7fc18c4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.070976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '250732d820d141c3872219f1d7fc18c4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.071644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d8574f64-efd0-4e21-bfe7-3d8ad0e8582a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '250732d820d141c3872219f1d7fc18c4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.077633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 945/1902] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:38 2021] DELETE /identity/v3/users/250732d820d141c3872219f1d7fc18c4 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:39.078945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.079233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.079518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.097802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:39.099056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.122705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.124597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8687f8-7e67-4f70-ab02-12836b5492e1 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.134614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 958/1903] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:39.160829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 946/1904] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:39.169331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.169621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.169922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.188425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:39.189612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.197426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 959/1905] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:39.201691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.211500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937fab3-2039-4af7-a540-fe178ddd281b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.217047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.217705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.217990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.218267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.219025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:39.219336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.220928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.232813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 947/1906] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:39.237045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.246863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b266f-a8d7-4389-94b2-12fbf7105bc2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.251521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.252154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.252433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.252706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.253386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.255346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.366010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 960/1907] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:39 2021] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:39.370418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.382760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7e209-4174-4d42-91b9-8d904f896cca admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.444547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.445317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.445663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.446006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.446794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.449532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.545715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.547838 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.563488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77f533-c348-419e-8239-219993538f4e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.572372 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.572971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 948/1908] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:39 2021] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:39.573436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.573790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.573932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.574235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] PATH_INFO: `/v3/projects/26618fc8d28740ff96e39eff2d6d223a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.576211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26618fc8d28740ff96e39eff2d6d223a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.578319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.588624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285d690-eb5f-4d98-bba1-7ae3950754ca admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.594147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.594887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.595165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.595437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.596730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.598413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.614617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 949/1909] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:39.617371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.630737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507557c3-05ce-4ffc-ba11-c3b1eb97f333 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.636540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.637406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.637636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.638289 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.640743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.650053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.664239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 950/1910] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:39 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:39.669526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.680959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635213b8-917e-4968-9094-ce0544a1c8f1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.688157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26618fc8d28740ff96e39eff2d6d223a', 'request_id': 'req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.695067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26618fc8d28740ff96e39eff2d6d223a', 'request_id': 'req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.741227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7279d2-2ce1-4a14-93b7-fc93d61decc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.742171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7279d2-2ce1-4a14-93b7-fc93d61decc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.742500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7279d2-2ce1-4a14-93b7-fc93d61decc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.742800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7279d2-2ce1-4a14-93b7-fc93d61decc9 admin admin] PATH_INFO: `/v3/projects/7e962f769aed4f348c5bccaa40a7ad50/users/6bbe3fcb4414452b893b9851d526e82d/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.757464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7279d2-2ce1-4a14-93b7-fc93d61decc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e962f769aed4f348c5bccaa40a7ad50, user_id=6bbe3fcb4414452b893b9851d526e82d, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.760227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7279d2-2ce1-4a14-93b7-fc93d61decc9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.764292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26618fc8d28740ff96e39eff2d6d223a', 'request_id': 'req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.778453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] The token cache is being invalidate because project 26618fc8d28740ff96e39eff2d6d223a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:39.778779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.779453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.781069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 961/1911] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:39 2021] DELETE /identity/v3/projects/26618fc8d28740ff96e39eff2d6d223a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:39.786709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:39.786709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.796195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef5c9b-4fb0-473b-bb14-cca0c627ea17 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:39.805452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:39.806280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.806544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.806882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] PATH_INFO: `/v3/projects/1cbc77b8f4eb41afb32c858b81d974df` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.808076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cbc77b8f4eb41afb32c858b81d974df)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:39.810593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:39.846841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 951/1912] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:39 2021] PUT /identity/v3/projects/7e962f769aed4f348c5bccaa40a7ad50/users/6bbe3fcb4414452b893b9851d526e82d/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:39.854707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d48e5-5cf2-4019-9a60-a99f7d93436d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.854707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d48e5-5cf2-4019-9a60-a99f7d93436d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.854707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d48e5-5cf2-4019-9a60-a99f7d93436d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.867644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-149d48e5-5cf2-4019-9a60-a99f7d93436d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:39.868842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-149d48e5-5cf2-4019-9a60-a99f7d93436d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:39.926272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 952/1913] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:39.927758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc535ab0-bf4e-4fca-b09c-4140b0f188ec None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:39.928198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc535ab0-bf4e-4fca-b09c-4140b0f188ec None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:39.928584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc535ab0-bf4e-4fca-b09c-4140b0f188ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:39.936789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cbc77b8f4eb41afb32c858b81d974df', 'request_id': 'req-f7c1ee86-4edf-4132-afde-d54631a31410'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.944210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cbc77b8f4eb41afb32c858b81d974df', 'request_id': 'req-f7c1ee86-4edf-4132-afde-d54631a31410'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:39.955542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-fc535ab0-bf4e-4fca-b09c-4140b0f188ec None None] MFA Rules not processed for user `6bbe3fcb4414452b893b9851d526e82d`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:39.956758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fc535ab0-bf4e-4fca-b09c-4140b0f188ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:40.024386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 953/1914] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:39 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:40.025719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44657446-942c-4695-87b4-76ad9eed4ee9 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.026033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44657446-942c-4695-87b4-76ad9eed4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.026290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44657446-942c-4695-87b4-76ad9eed4ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.038526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cbc77b8f4eb41afb32c858b81d974df', 'request_id': 'req-f7c1ee86-4edf-4132-afde-d54631a31410'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:40.044647 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-44657446-942c-4695-87b4-76ad9eed4ee9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:40.045839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-44657446-942c-4695-87b4-76ad9eed4ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:40.049696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] The token cache is being invalidate because project 1cbc77b8f4eb41afb32c858b81d974df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:40.049984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:40.050648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:40.052189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 962/1915] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:39 2021] DELETE /identity/v3/projects/1cbc77b8f4eb41afb32c858b81d974df => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:40.052920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.054179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:40.103566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 954/1916] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:40.104904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.105190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.105977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.116898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1ee86-4edf-4132-afde-d54631a31410 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.122144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.122826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.123105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.123379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.123695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:40.124057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.124871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:40.125962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.132578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 955/1917] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:40.133342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.142770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffc1a2-469f-4f9d-9683-b0450ed07bef None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.147331 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.147969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.155261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.155261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.155261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:40.155261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.155261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19523b-5683-466c-8d34-76e8811fcf43 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.162533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 956/1918] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:40.163712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.164002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.164274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.184210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:40.184210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:40.190318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 957/1919] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:40.191135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.200261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfe09fc-e6a4-4195-a127-a3ccc46a71a0 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.204762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.205373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.205653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.205923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.206605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.208472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.274348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 963/1920] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:40.275387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.322831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 958/1921] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:40.327561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.334062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35a8ed-154b-49d6-aaa3-67dbc8e8882e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.387659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.387922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed4527-9a61-499a-b570-1f45c4e619ab admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.388323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.388616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.388884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.389597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:40.389903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.391693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.392962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.393865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.394152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.394425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.395145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.397053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.402779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 964/1922] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:40.403551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.412713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c94f-250a-4254-a4c1-e971afb1ad78 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.417521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.418199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.418466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.418789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.419508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.421385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.507193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 959/1923] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/users => generated 294 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:40.508964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.518488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e3a97-21ab-4ff4-af22-675e8c87bc74 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.525145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.525804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.526086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.526360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.527084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.532446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.532574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 965/1924] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/users => generated 285 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:40.533916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.543589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db579b00-729c-40c6-ab81-344beb3985d8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.548310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.548965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.549246 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.549515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.550227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.551866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.562618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 966/1925] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:40.563396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.572357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005027d2-25f4-499b-8610-33872e458e04 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.577105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.577750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.578026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.578294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.579024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.580546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.590316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 967/1926] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:40.591203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.600125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351c088-2a0a-4e1e-bb8c-55508a2e521a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.604780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.606160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.606444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.606752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] PATH_INFO: `/v3/projects/a3423b9e3b444f388ca392938fba4383/users/d8f51118e05a40be830dee582227a5db/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.614595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 960/1927] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:40.618508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.620990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3423b9e3b444f388ca392938fba4383, user_id=d8f51118e05a40be830dee582227a5db, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.624188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.675454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7c95a2-b83b-44a5-a4e9-6687879b677b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.680732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.681393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.681670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.681945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.682697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.684997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.688348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 968/1928] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:40 2021] PUT /identity/v3/projects/a3423b9e3b444f388ca392938fba4383/users/d8f51118e05a40be830dee582227a5db/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:40.689151 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.700978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 961/1929] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:40.700978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.708576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a8d03-a17e-4565-b59f-c88d4fea04a4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.750447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff05ef-825b-4fb3-b1ae-4a7a06c6b461 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.755888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.756568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.756849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.757120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.757877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.759801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.766968 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.767676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.767957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.768259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.768978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.770614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.780233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 962/1930] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:40.780998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.790116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8f2b3-d4ac-4f22-a4d7-a2ec371a587e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.795244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687cd81-85d7-490a-befa-ae85170eecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.796093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687cd81-85d7-490a-befa-ae85170eecc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.796373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687cd81-85d7-490a-befa-ae85170eecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.796648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687cd81-85d7-490a-befa-ae85170eecc4 admin admin] PATH_INFO: `/v3/projects/71fb819321844be4958772e1861f3d71/users/bcbade6ae0304c0eaa229935fc60ed3a/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.812043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687cd81-85d7-490a-befa-ae85170eecc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fb819321844be4958772e1861f3d71, user_id=bcbade6ae0304c0eaa229935fc60ed3a, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.820858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687cd81-85d7-490a-befa-ae85170eecc4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.844165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 969/1931] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:40.845105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.854382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab477d5-cc6e-48ff-9a97-2a05d34d4dcd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:40.859462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:40.860332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.860614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.860885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] PATH_INFO: `/v3/projects/a3423b9e3b444f388ca392938fba4383/users/d8f51118e05a40be830dee582227a5db/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.863102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3423b9e3b444f388ca392938fba4383, user_id=d8f51118e05a40be830dee582227a5db, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:40.865718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:40.876437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 970/1932] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:40 2021] PUT /identity/v3/projects/a3423b9e3b444f388ca392938fba4383/users/d8f51118e05a40be830dee582227a5db/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:40.876972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:40.915815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 963/1933] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:40 2021] PUT /identity/v3/projects/71fb819321844be4958772e1861f3d71/users/bcbade6ae0304c0eaa229935fc60ed3a/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:40.925935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:40.925935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:40.925935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:40.938495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b4e6a-dd66-4df8-9298-c587e9888c26 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:41.010242 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fab05-2a3e-43f8-9b8d-d21230001704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:41.010872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fab05-2a3e-43f8-9b8d-d21230001704 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.011156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fab05-2a3e-43f8-9b8d-d21230001704 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.011432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fab05-2a3e-43f8-9b8d-d21230001704 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.012201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fab05-2a3e-43f8-9b8d-d21230001704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:41.013883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fab05-2a3e-43f8-9b8d-d21230001704 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:41.028454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 971/1934] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:40 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:41.028454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171116df-61d5-433b-bca3-742a4d67554d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.028454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171116df-61d5-433b-bca3-742a4d67554d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.028454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171116df-61d5-433b-bca3-742a4d67554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.060181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-171116df-61d5-433b-bca3-742a4d67554d None None] MFA Rules not processed for user `bcbade6ae0304c0eaa229935fc60ed3a`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:41.062373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-171116df-61d5-433b-bca3-742a4d67554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.072994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] MFA Rules not processed for user `d8f51118e05a40be830dee582227a5db`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:41.074204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.135920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 972/1935] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:41 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:41.136854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171116df-61d5-433b-bca3-742a4d67554d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:41.149011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171116df-61d5-433b-bca3-742a4d67554d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:41.155908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:41.156574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.156855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.156986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 964/1936] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:40 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:41.157127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.157696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:41.157852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:41.158992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.159494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:41.170602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 973/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:41 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:41.171427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:41.173169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.218602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8fffd-cbd5-4991-8c64-ae52f58ad9e4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:41.222238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:41.222923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.223209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.223482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.227748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d8885-04e9-4227-b20b-d5e04b3db923 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:41.232655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:41.233126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:41.233776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.234060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.234152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:41.242994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.242994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.243766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 965/1938] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:41 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:41.244336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:41.257469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3a62f-a364-4966-8f42-74826e5b64e2 service glance] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:41.266099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:41.266099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.266099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.266099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] PATH_INFO: `/v3/projects/2d4061dd7eb245a69b1eff088985076c/users/4c80843a900943ecb7d312088d9bf04b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.280598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4061dd7eb245a69b1eff088985076c, user_id=4c80843a900943ecb7d312088d9bf04b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:41.283304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:41.301140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:41.302682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df685b9c-56d2-4ccf-9c53-5630fef88d4d service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:41.315400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 974/1939] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:41 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:41.420978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 966/1940] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:41 2021] PUT /identity/v3/projects/2d4061dd7eb245a69b1eff088985076c/users/4c80843a900943ecb7d312088d9bf04b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:41.426286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c62de-e094-481b-85e8-20a86b2021bb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.426595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c62de-e094-481b-85e8-20a86b2021bb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.426886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c62de-e094-481b-85e8-20a86b2021bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.445022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-409c62de-e094-481b-85e8-20a86b2021bb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:41.446210 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-409c62de-e094-481b-85e8-20a86b2021bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.505519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 975/1941] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:41.516108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:41.517929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:41.573431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c621-1c61-4db8-b394-dee71a710d20 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:41.577688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:41.578330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:41.578644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:41.578923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:41.588333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:41.589790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:41.599901 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 967/1942] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:42.975885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350176-29c9-4495-973b-972385fcac5e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:42.976519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350176-29c9-4495-973b-972385fcac5e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:42.976519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76350176-29c9-4495-973b-972385fcac5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:43.002977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-76350176-29c9-4495-973b-972385fcac5e None None] MFA Rules not processed for user `4c80843a900943ecb7d312088d9bf04b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:43.004170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-76350176-29c9-4495-973b-972385fcac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:43.072253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 976/1943] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:42 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:43.084443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:43.152326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fa86f-d1ad-49e9-b136-c4415b68f467 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:43.156365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd640d1f-c04d-4f6a-9ef3-0433a005bd02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:43.157084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640d1f-c04d-4f6a-9ef3-0433a005bd02 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:43.157373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640d1f-c04d-4f6a-9ef3-0433a005bd02 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:43.157646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd640d1f-c04d-4f6a-9ef3-0433a005bd02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:43.166553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd640d1f-c04d-4f6a-9ef3-0433a005bd02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:43.168009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd640d1f-c04d-4f6a-9ef3-0433a005bd02 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:43.182661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 968/1944] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:43 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:44.559980 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350176-29c9-4495-973b-972385fcac5e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:44.562081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-76350176-29c9-4495-973b-972385fcac5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:44.575377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76350176-29c9-4495-973b-972385fcac5e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:44.579947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:44.580845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:44.581126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:44.581394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] PATH_INFO: `/v3/users/569faca969b244bc9cfefe1680ad20f2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:44.582603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=569faca969b244bc9cfefe1680ad20f2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:44.584514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:44.791043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '569faca969b244bc9cfefe1680ad20f2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:44.802921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '569faca969b244bc9cfefe1680ad20f2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:44.809294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '569faca969b244bc9cfefe1680ad20f2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:44.897865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '569faca969b244bc9cfefe1680ad20f2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:44.898522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '569faca969b244bc9cfefe1680ad20f2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:44.904549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 977/1945] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:44 2021] DELETE /identity/v3/users/569faca969b244bc9cfefe1680ad20f2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:44.909071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:44.913640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:44.913640 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:44.926459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:44.927714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:44.984275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 969/1946] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:44.994275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:44.995752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:45.050189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaa74-a001-4541-84d6-080a9716dc9c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:45.053767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:45.054350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:45.054659 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:45.054936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:45.064390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:45.065859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:45.075603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 978/1947] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:45.489391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:45.490995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:45.505286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b4ec8-e976-41b3-b01d-246d6183d56a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:45.510059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:45.510959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:45.511336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:45.511502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] PATH_INFO: `/v3/projects/6baf9844ab1f48288b5b074cbe65cf86` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:45.512849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6baf9844ab1f48288b5b074cbe65cf86)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:45.514780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:45.621276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6baf9844ab1f48288b5b074cbe65cf86', 'request_id': 'req-920baeea-7deb-465d-af9f-930009b339e1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.627535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6baf9844ab1f48288b5b074cbe65cf86', 'request_id': 'req-920baeea-7deb-465d-af9f-930009b339e1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.680881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6baf9844ab1f48288b5b074cbe65cf86', 'request_id': 'req-920baeea-7deb-465d-af9f-930009b339e1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.691161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] The token cache is being invalidate because project 6baf9844ab1f48288b5b074cbe65cf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:45.691448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.692098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.693726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 970/1948] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:45 2021] DELETE /identity/v3/projects/6baf9844ab1f48288b5b074cbe65cf86 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:45.697582 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:45.707771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4a7af-2efb-4e9d-9426-1e6970978619 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:45.765154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:45.766035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:45.766312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:45.766607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] PATH_INFO: `/v3/users/7afde94fca0c4a998451c445080cf0c4` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:45.769581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7afde94fca0c4a998451c445080cf0c4)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:45.769685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:45.948787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7afde94fca0c4a998451c445080cf0c4'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.960878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7afde94fca0c4a998451c445080cf0c4'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:45.968057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7afde94fca0c4a998451c445080cf0c4'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.044138 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7afde94fca0c4a998451c445080cf0c4'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.044846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-21f1eeac-a9ef-4201-b327-950e9557d07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7afde94fca0c4a998451c445080cf0c4'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.050870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 979/1949] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:45 2021] DELETE /identity/v3/users/7afde94fca0c4a998451c445080cf0c4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:46.493789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:46.498483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:46.511385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920baeea-7deb-465d-af9f-930009b339e1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:46.568077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:46.572787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:46.572787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:46.572787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] PATH_INFO: `/v3/projects/06b55b698b7f4b518d85ab060cbb1d0a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:46.572787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b55b698b7f4b518d85ab060cbb1d0a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:46.572787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:46.662040 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b55b698b7f4b518d85ab060cbb1d0a', 'request_id': 'req-d10f465d-baf8-4edf-87ac-2be325b0c0cc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.667974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b55b698b7f4b518d85ab060cbb1d0a', 'request_id': 'req-d10f465d-baf8-4edf-87ac-2be325b0c0cc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.732937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b55b698b7f4b518d85ab060cbb1d0a', 'request_id': 'req-d10f465d-baf8-4edf-87ac-2be325b0c0cc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.743437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] The token cache is being invalidate because project 06b55b698b7f4b518d85ab060cbb1d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:46.744635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.744635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d10f465d-baf8-4edf-87ac-2be325b0c0cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:46.745892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 971/1950] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:46 2021] DELETE /identity/v3/projects/06b55b698b7f4b518d85ab060cbb1d0a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:46.753994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:46.754471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:46.754572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:46.771925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:46.773143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:46.831748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 980/1951] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:46.839540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:46.839827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:46.840095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:46.859039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:46.860212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:46.868133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 972/1952] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:46.872104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:46.882053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c11fe-9382-4eb1-a52c-664fa905075e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:46.886520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:46.887463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:46.887752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:46.888027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:46.888738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:46.889053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:46.890650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:46.901456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 981/1953] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:46.905939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:46.914706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c1bfc-70f8-4daf-b733-75c7f9d9ea87 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:46.919223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:46.920484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:46.920758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:46.921025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:46.921735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:46.923646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.003729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 973/1954] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:46 2021] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:47.008025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.017667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cbd4de-781d-4adc-a91a-c668df6e35b4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.071266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.071945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.072221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.072491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.073178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.075110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.149630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 982/1955] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:47 2021] POST /identity/v3/users => generated 305 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:47.151301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.162171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b4812-5877-41b6-813d-5ed89abfb655 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.166809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.167471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.167750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.168040 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.168742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.170942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.181606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 974/1956] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:47.187918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.197763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5146a4a-e3e2-4b87-85c7-75e75fe76197 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.202487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac34c6-04ee-47ee-972c-c62c184759ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.208135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac34c6-04ee-47ee-972c-c62c184759ce admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.208135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac34c6-04ee-47ee-972c-c62c184759ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.208135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac34c6-04ee-47ee-972c-c62c184759ce admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.208135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac34c6-04ee-47ee-972c-c62c184759ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.208135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac34c6-04ee-47ee-972c-c62c184759ce admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.219771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 983/1957] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:47.221143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.230904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484de4b-30d4-41e4-9ea0-af65a5d5704a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.236141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.244288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.244288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.244288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] PATH_INFO: `/v3/projects/e73daf7afaa241418c048b6b390dec14/users/e38f3714822944d6802f38b3b267b5d6/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.251710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e73daf7afaa241418c048b6b390dec14, user_id=e38f3714822944d6802f38b3b267b5d6, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.254344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.338137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 975/1958] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:47 2021] PUT /identity/v3/projects/e73daf7afaa241418c048b6b390dec14/users/e38f3714822944d6802f38b3b267b5d6/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:47.349979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.350273 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.350549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.377488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] MFA Rules not processed for user `e38f3714822944d6802f38b3b267b5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:47.378716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:47.442198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 984/1959] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:47 2021] POST /identity/v3/auth/tokens => generated 3429 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:47.447087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.513911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d6e13-49bc-45e3-b8c3-b14d44c8a219 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.519081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.519786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.520075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.520349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.521051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.523657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.632698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 976/1960] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:47 2021] POST /identity/v3/projects => generated 409 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:47.633896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.645501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658051ee-20ed-4c15-a523-5ef46af9a5cb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.707778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.708439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.708724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.709001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.709706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.711695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.831036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 985/1961] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:47 2021] POST /identity/v3/users => generated 311 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:47.835224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.847553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7db4d-dbd0-4b1c-9b09-e38839abec80 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.852224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.857752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.857752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.857752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.857752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.857752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.874405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 977/1962] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:47.875687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:47.886758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f64a9-be3b-4402-8187-919f72498642 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:47.891797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:47.892707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:47.892994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:47.893278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] PATH_INFO: `/v3/projects/0a7c437c623b43a2aaf77eb41826daaa/users/9af748b09a2e4b849a77cdcc07794c0e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:47.915089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7c437c623b43a2aaf77eb41826daaa, user_id=9af748b09a2e4b849a77cdcc07794c0e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:47.915089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:47.985114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 986/1963] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:47 2021] PUT /identity/v3/projects/0a7c437c623b43a2aaf77eb41826daaa/users/9af748b09a2e4b849a77cdcc07794c0e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:47.989546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:48.000129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbaf457-f54a-4766-a675-217d8744bbdd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:48.056033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc76c2-4844-4b17-9d21-043c9c1afe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:48.056722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc76c2-4844-4b17-9d21-043c9c1afe60 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.057007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc76c2-4844-4b17-9d21-043c9c1afe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.057284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc76c2-4844-4b17-9d21-043c9c1afe60 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.058072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc76c2-4844-4b17-9d21-043c9c1afe60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:48.059705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc76c2-4844-4b17-9d21-043c9c1afe60 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:48.072282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 978/1964] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:47 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:48.076978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:48.087259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7cf00-beb1-42fd-b9a6-bc6f9d7baa12 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:48.091980 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:48.092856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.093143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.093419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] PATH_INFO: `/v3/projects/0a7c437c623b43a2aaf77eb41826daaa/users/9af748b09a2e4b849a77cdcc07794c0e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.095397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7c437c623b43a2aaf77eb41826daaa, user_id=9af748b09a2e4b849a77cdcc07794c0e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:48.098083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:48.109924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 987/1965] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:48 2021] PUT /identity/v3/projects/0a7c437c623b43a2aaf77eb41826daaa/users/9af748b09a2e4b849a77cdcc07794c0e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:48.120188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.120480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.120759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.146978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] MFA Rules not processed for user `9af748b09a2e4b849a77cdcc07794c0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:48.148174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:48.217609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:48.219307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:48.223907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 979/1966] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:48 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:48.272003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:48.273373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:48.285603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaddff-6cb9-4b07-9bc5-a317bb2d2963 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:48.289711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd92884-4761-47a4-887a-367689d46190 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:48.289847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef128773-0743-4963-8a9c-ba2e3a474c62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:48.289942 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:48.290031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef128773-0743-4963-8a9c-ba2e3a474c62 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.290229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef128773-0743-4963-8a9c-ba2e3a474c62 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.290490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.290613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef128773-0743-4963-8a9c-ba2e3a474c62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.290801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.291075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.292840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:48.300648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef128773-0743-4963-8a9c-ba2e3a474c62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:48.302077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef128773-0743-4963-8a9c-ba2e3a474c62 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:48.312697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 980/1967] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:48 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:16:48.357563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:48.359056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:48.370638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 988/1968] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:48 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:48.615513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.615513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.615513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.629929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] MFA Rules not processed for user `4c80843a900943ecb7d312088d9bf04b`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:48.631156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:48.686315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 981/1969] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:48 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:48.717484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:48.725739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b821fe-883f-4cf7-8306-8b953db7a5b5 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:48.729819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07581a0d-f828-4a9f-bfdd-927bc6c67b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:48.730478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07581a0d-f828-4a9f-bfdd-927bc6c67b9e service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:48.730788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07581a0d-f828-4a9f-bfdd-927bc6c67b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:48.731062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07581a0d-f828-4a9f-bfdd-927bc6c67b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:48.818304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07581a0d-f828-4a9f-bfdd-927bc6c67b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:48.820277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07581a0d-f828-4a9f-bfdd-927bc6c67b9e service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:48.830830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 989/1970] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:48 2021] GET /identity/v3/auth/tokens => generated 3429 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:50.039961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:50.041457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:50.106826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da1a5d-5e3f-4cc3-86bd-4602210c3f88 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:50.112525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:50.113993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:50.114524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:50.114872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] PATH_INFO: `/v3/users/4ba3c7e0b6314f1aad05dec4a1110c17` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:50.116078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ba3c7e0b6314f1aad05dec4a1110c17)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:50.118016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:50.288494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ba3c7e0b6314f1aad05dec4a1110c17'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:50.300470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ba3c7e0b6314f1aad05dec4a1110c17'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:50.367072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ba3c7e0b6314f1aad05dec4a1110c17'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:50.375798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ba3c7e0b6314f1aad05dec4a1110c17'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:50.376426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ba3c7e0b6314f1aad05dec4a1110c17'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:50.383278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 982/1971] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:50 2021] DELETE /identity/v3/users/4ba3c7e0b6314f1aad05dec4a1110c17 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:50.387646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612724-188a-4792-a412-7582e25a8e9d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:50.388149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612724-188a-4792-a412-7582e25a8e9d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:50.388235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63612724-188a-4792-a412-7582e25a8e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:50.407706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-63612724-188a-4792-a412-7582e25a8e9d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:50.408958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-63612724-188a-4792-a412-7582e25a8e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:50.466717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 990/1972] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:50.476693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:50.478387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:50.537837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955688dc-d383-4201-aaa5-c4feaf5bb95f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:50.541619 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:50.542246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:50.542522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:50.543023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:50.553034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:50.554535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:50.564880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 983/1973] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:50.975038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612724-188a-4792-a412-7582e25a8e9d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:50.976495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-63612724-188a-4792-a412-7582e25a8e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:50.993385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63612724-188a-4792-a412-7582e25a8e9d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:50.999660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:51.000530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:51.000815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:51.001118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] PATH_INFO: `/v3/projects/f26824cf066d4b12822dc08e32a27619` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:51.002494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26824cf066d4b12822dc08e32a27619)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:51.004469 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:51.117971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26824cf066d4b12822dc08e32a27619', 'request_id': 'req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.123883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26824cf066d4b12822dc08e32a27619', 'request_id': 'req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.186517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26824cf066d4b12822dc08e32a27619', 'request_id': 'req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.196997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] The token cache is being invalidate because project f26824cf066d4b12822dc08e32a27619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:51.197283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.197897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.199455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 991/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:50 2021] DELETE /identity/v3/projects/f26824cf066d4b12822dc08e32a27619 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:51.203901 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:51.213233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674fd9ce-995e-4db8-a854-fa97ccb89ba2 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:51.267773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:51.268687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:51.268931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:51.269204 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] PATH_INFO: `/v3/users/e1f45e3726294f7b910fc43e66273aa0` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:51.270392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f45e3726294f7b910fc43e66273aa0)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:51.272341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:51.505748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f45e3726294f7b910fc43e66273aa0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.517536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f45e3726294f7b910fc43e66273aa0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.589766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f45e3726294f7b910fc43e66273aa0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.596987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f45e3726294f7b910fc43e66273aa0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.597611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7985107b-3de8-41dc-8b51-5ac53a0e5ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f45e3726294f7b910fc43e66273aa0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:51.603576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 984/1975] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:51 2021] DELETE /identity/v3/users/e1f45e3726294f7b910fc43e66273aa0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:51.989383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:51.990925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:52.004625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d52be-fb5b-471a-a576-bba7fbd9eb9e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.059298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.060194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.060480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.060757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] PATH_INFO: `/v3/projects/6ae9c6f153314f8b8167c03ab14c840a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.061922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae9c6f153314f8b8167c03ab14c840a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.063852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.166497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae9c6f153314f8b8167c03ab14c840a', 'request_id': 'req-474f3da4-7260-41fe-9332-9df6a7e87898'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:52.172564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae9c6f153314f8b8167c03ab14c840a', 'request_id': 'req-474f3da4-7260-41fe-9332-9df6a7e87898'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:52.269604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae9c6f153314f8b8167c03ab14c840a', 'request_id': 'req-474f3da4-7260-41fe-9332-9df6a7e87898'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:52.280148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] The token cache is being invalidate because project 6ae9c6f153314f8b8167c03ab14c840a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:52.280432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:52.281425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-474f3da4-7260-41fe-9332-9df6a7e87898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:52.282640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 992/1976] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:51 2021] DELETE /identity/v3/projects/6ae9c6f153314f8b8167c03ab14c840a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:52.288293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.288856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.288856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.306341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:52.307580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:52.364782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 985/1977] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:52.373851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74a680-071a-4a72-8253-725e05201abb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.374135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74a680-071a-4a72-8253-725e05201abb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.374409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74a680-071a-4a72-8253-725e05201abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.393416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2c74a680-071a-4a72-8253-725e05201abb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:52.394642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2c74a680-071a-4a72-8253-725e05201abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:52.402922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 993/1978] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:52.407166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:52.416844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb37de59-80be-4ce5-b913-bfc508019708 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.421520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.422182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.422465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.422767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.423520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:52.423827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.425409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.437857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 986/1979] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:52.442113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74a680-071a-4a72-8253-725e05201abb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:52.451802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74a680-071a-4a72-8253-725e05201abb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.456680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.457329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.457609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.457881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.458967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.460853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.554628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 994/1980] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:52 2021] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:52.559024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:52.569553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462e407-8162-4f5a-954d-2000b01f105e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.623583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.624257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.624537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.624805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.625499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.627450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.739607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 987/1981] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:52 2021] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:52.744034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:52.756171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece9b00-07d0-4779-a5cd-f6f56c0b8763 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.761627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.762288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.762591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.762884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.763609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.765245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.776305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 995/1982] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:52.780126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:52.789867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9eb856-e265-4d8d-a78e-d688e986abd4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.794496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada65d46-df4e-4ebe-b1e8-86ea9f199b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.795701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65d46-df4e-4ebe-b1e8-86ea9f199b2c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.795985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65d46-df4e-4ebe-b1e8-86ea9f199b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.796260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada65d46-df4e-4ebe-b1e8-86ea9f199b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.797226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada65d46-df4e-4ebe-b1e8-86ea9f199b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.798617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada65d46-df4e-4ebe-b1e8-86ea9f199b2c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.808818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 988/1983] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:52.813634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:52.823763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7ca8f-825f-483a-8e17-552b2e9f180e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:52.828664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:52.829552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.829837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.830117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] PATH_INFO: `/v3/projects/49c00ad3bbd34f8188156b4179c94526/users/4bcd032c492d4a40b2743546c82860c0/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:52.844266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=49c00ad3bbd34f8188156b4179c94526, user_id=4bcd032c492d4a40b2743546c82860c0, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:52.846985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:52.967244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 996/1984] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:52 2021] PUT /identity/v3/projects/49c00ad3bbd34f8188156b4179c94526/users/4bcd032c492d4a40b2743546c82860c0/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:52.973985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:52.974353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:52.974680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.021743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] MFA Rules not processed for user `4bcd032c492d4a40b2743546c82860c0`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:53.023831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:53.100310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 989/1985] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:52 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:53.104803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.166316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202ff20-f354-407b-834e-c004420458ec admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.171649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:53.172304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.172585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.172859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.173548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:53.175543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:53.316719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 997/1986] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:53 2021] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:53.318995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.336026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abae0a8-17dc-4fc0-99d3-474f2c4b7ac5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.392711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:53.393381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.393664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.393937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.394721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:53.396693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:53.528794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 990/1987] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:53 2021] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:53.530078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.540475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3484a3-0a3c-4946-88a9-a87bbeba395c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.545557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:53.546349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.546685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.546964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.547698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:53.549397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:53.561991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 998/1988] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:16:53.568711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.579266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b094d-1c39-43d2-9478-dfe06ffb15ab admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.583993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:53.584847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.585131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.585407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] PATH_INFO: `/v3/projects/195de2de6417484c8e2715a055a15250/users/84e122c2ff4340999761e545ce3e10f7/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.600853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=195de2de6417484c8e2715a055a15250, user_id=84e122c2ff4340999761e545ce3e10f7, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:53.603562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:53.681666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 991/1989] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:53 2021] PUT /identity/v3/projects/195de2de6417484c8e2715a055a15250/users/84e122c2ff4340999761e545ce3e10f7/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:53.687183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.697775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e852b3-a5fc-4483-b62f-8edca4bcac41 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.753549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce73bd-1285-4703-ae7e-72093279255d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:53.754218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce73bd-1285-4703-ae7e-72093279255d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.754562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce73bd-1285-4703-ae7e-72093279255d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.754862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce73bd-1285-4703-ae7e-72093279255d admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.755586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce73bd-1285-4703-ae7e-72093279255d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:53.757343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce73bd-1285-4703-ae7e-72093279255d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:53.771495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 999/1990] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:53 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:53.773459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.784923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f32f30-7d46-40a6-bd00-371cff6f8dbc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.789639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:53.790676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.790999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.791346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] PATH_INFO: `/v3/projects/195de2de6417484c8e2715a055a15250/users/84e122c2ff4340999761e545ce3e10f7/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.793324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=195de2de6417484c8e2715a055a15250, user_id=84e122c2ff4340999761e545ce3e10f7, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:53.796694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:53.807631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 992/1991] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:53 2021] PUT /identity/v3/projects/195de2de6417484c8e2715a055a15250/users/84e122c2ff4340999761e545ce3e10f7/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:53.818814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:53.819113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:53.819393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:53.847056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] MFA Rules not processed for user `84e122c2ff4340999761e545ce3e10f7`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:53.848358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:53.924146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1000/1992] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:53 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:53.930972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:53.932666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:53.995299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e0380-8f30-4a02-a6d5-f90ca52dfdfc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:53.999354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008b255-c40c-4ac9-95b0-98161f4c742f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:54.000013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b255-c40c-4ac9-95b0-98161f4c742f service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:54.000298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b255-c40c-4ac9-95b0-98161f4c742f service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:54.000573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008b255-c40c-4ac9-95b0-98161f4c742f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:54.009671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b255-c40c-4ac9-95b0-98161f4c742f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:54.011170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008b255-c40c-4ac9-95b0-98161f4c742f service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:54.022641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 993/1993] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:53 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:16:54.870671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:54.938731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d53b1c-7549-4e33-8dcc-c40349bcea10 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:54.947615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:54.948544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:54.948911 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:54.949292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] PATH_INFO: `/v3/users/4bcd032c492d4a40b2743546c82860c0` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:54.950515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bcd032c492d4a40b2743546c82860c0)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:54.953994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:55.198775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bcd032c492d4a40b2743546c82860c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:55.211287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bcd032c492d4a40b2743546c82860c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:55.218528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bcd032c492d4a40b2743546c82860c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:55.355752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bcd032c492d4a40b2743546c82860c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:55.356373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bcd032c492d4a40b2743546c82860c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:55.368730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1001/1994] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:54 2021] DELETE /identity/v3/users/4bcd032c492d4a40b2743546c82860c0 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:55.373463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:55.374590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:55.374872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:55.396894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:55.398092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:55.456503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 994/1995] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:55.466180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:55.468236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:55.527375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08241420-2a1f-4cc0-8d5c-9fdee540aca8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:55.531962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:55.532655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:55.532940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:55.533218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:55.543000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:55.545502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:55.553922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1002/1996] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:16:55.943045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:55.945141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:55.957646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711a6fb-6426-422c-bffb-b5a47150a605 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:55.962510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:55.964205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:55.964833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:55.965194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] PATH_INFO: `/v3/projects/49c00ad3bbd34f8188156b4179c94526` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:55.966380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49c00ad3bbd34f8188156b4179c94526)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:55.968823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:56.096785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49c00ad3bbd34f8188156b4179c94526', 'request_id': 'req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.103241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49c00ad3bbd34f8188156b4179c94526', 'request_id': 'req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.189687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49c00ad3bbd34f8188156b4179c94526', 'request_id': 'req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.200823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] The token cache is being invalidate because project 49c00ad3bbd34f8188156b4179c94526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:56.201108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.201777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.203387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 995/1997] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:55 2021] DELETE /identity/v3/projects/49c00ad3bbd34f8188156b4179c94526 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:56.207322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:56.217289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6e556-ca1e-4367-aa44-98f8593ccf6f service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:56.275064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:56.276217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:56.276493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:56.276762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] PATH_INFO: `/v3/users/84e122c2ff4340999761e545ce3e10f7` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:56.277951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84e122c2ff4340999761e545ce3e10f7)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:56.280539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:56.493033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84e122c2ff4340999761e545ce3e10f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.507418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84e122c2ff4340999761e545ce3e10f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.515382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84e122c2ff4340999761e545ce3e10f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.607068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84e122c2ff4340999761e545ce3e10f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.607697 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-8286c10e-7a97-4e3f-87fc-b847f467cd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84e122c2ff4340999761e545ce3e10f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:56.614260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1003/1998] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:16:56 2021] DELETE /identity/v3/users/84e122c2ff4340999761e545ce3e10f7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:57.029365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.037906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:57.047687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b6098-4bdf-4b9d-9319-f6be37069a1a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.105391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.106265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.106546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.106855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] PATH_INFO: `/v3/projects/195de2de6417484c8e2715a055a15250` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.108541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=195de2de6417484c8e2715a055a15250)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.110442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.218018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195de2de6417484c8e2715a055a15250', 'request_id': 'req-151d11b0-f29d-483c-8a65-df1bb192d6fe'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:57.224085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195de2de6417484c8e2715a055a15250', 'request_id': 'req-151d11b0-f29d-483c-8a65-df1bb192d6fe'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:57.304916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195de2de6417484c8e2715a055a15250', 'request_id': 'req-151d11b0-f29d-483c-8a65-df1bb192d6fe'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:57.316095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] The token cache is being invalidate because project 195de2de6417484c8e2715a055a15250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:16:57.316382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:57.317002 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-151d11b0-f29d-483c-8a65-df1bb192d6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:16:57.318539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 996/1999] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:16:57 2021] DELETE /identity/v3/projects/195de2de6417484c8e2715a055a15250 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:57.324575 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.325032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.325199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.343125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:57.344334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:57.404684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1004/2000] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:57.412263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.412547 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.412819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.431821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:57.433142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:57.442979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 997/2001] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:57.447223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.457619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289d8ed-f994-4e56-9ed2-78debd1fe5f2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.462187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.462873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.463157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.463431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.464150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:16:57.464456 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.466055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.478783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1005/2002] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:16:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:16:57.487675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.497553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0494b-e6d0-44eb-b30c-806f19158199 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.502217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.502994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.503265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.503521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.504213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.506126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.597725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 998/2003] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:57 2021] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:57.601709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.612868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c77aa5-4ed8-49df-ba92-3be503edf858 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.668224 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.668903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.669189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.669473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.670810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.672740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.764704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1006/2004] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:57 2021] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:57.765920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.775975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57d147-ae95-4b82-be39-24f2a5bb343d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.781488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.782198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.782491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.782798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.783517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.785099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.795594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 999/2005] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:57.806236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.816223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf5c40-8d3f-4108-b503-3dce05528431 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.820815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6352d7-baec-4f4a-acf6-fe9ef65e70db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.821472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6352d7-baec-4f4a-acf6-fe9ef65e70db admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.821756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6352d7-baec-4f4a-acf6-fe9ef65e70db admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.822033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6352d7-baec-4f4a-acf6-fe9ef65e70db admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.822811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6352d7-baec-4f4a-acf6-fe9ef65e70db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.824412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6352d7-baec-4f4a-acf6-fe9ef65e70db admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.835203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1007/2006] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:57 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:57.839293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:57.849750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582998-1ed2-4535-b87d-3babf7a4ac54 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:57.854221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:57.855116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.855392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.855662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] PATH_INFO: `/v3/projects/fa566f160dfb43d8a97b07f53958a72e/users/909386942ff846028fc70fe4f9693cdc/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.871093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa566f160dfb43d8a97b07f53958a72e, user_id=909386942ff846028fc70fe4f9693cdc, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:57.873810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:57.950223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1000/2007] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:57 2021] PUT /identity/v3/projects/fa566f160dfb43d8a97b07f53958a72e/users/909386942ff846028fc70fe4f9693cdc/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:57.960744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:57.962335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:57.962335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:57.989297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] MFA Rules not processed for user `909386942ff846028fc70fe4f9693cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:57.990500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:58.054064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1008/2008] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:57 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:16:58.058725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.118313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fe3858-cd1a-419c-aac9-fe3c623d7983 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.123645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.124319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.124603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.124882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.125583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.127804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.229059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1001/2009] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:16:58 2021] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:16:58.230334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.243072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263e975-10a5-4976-a61b-b5c35e09f482 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.315343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.316025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.316306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.316676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.320006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.320006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.413472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1009/2010] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:16:58 2021] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:16:58.417472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.428738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6eff-5088-40cb-91e4-f81962bfc7a2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.433824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.434614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.434841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.435141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.435909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.437520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.450119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1002/2011] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:58 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:58.453835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.465493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addcc31-01c1-4edb-a763-bfafdfe16eb0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.476244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.480279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.480279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.480279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] PATH_INFO: `/v3/projects/d1892d1796394123a1f60c389706f560/users/5309e75ed2f248879bf49cfc350deecc/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.496856 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1892d1796394123a1f60c389706f560, user_id=5309e75ed2f248879bf49cfc350deecc, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.503189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.583272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1010/2012] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:58 2021] PUT /identity/v3/projects/d1892d1796394123a1f60c389706f560/users/5309e75ed2f248879bf49cfc350deecc/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:16:58.587428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.598073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b447a-48df-4417-a761-d4bfca3aef90 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.657101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda6c1a-3393-46d9-9a01-41c4bd2dd4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.657779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6c1a-3393-46d9-9a01-41c4bd2dd4bb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.658063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6c1a-3393-46d9-9a01-41c4bd2dd4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.658340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda6c1a-3393-46d9-9a01-41c4bd2dd4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.659097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6c1a-3393-46d9-9a01-41c4bd2dd4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.660699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda6c1a-3393-46d9-9a01-41c4bd2dd4bb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.672396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1003/2013] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:16:58 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:16:58.675860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.692155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37649192-e930-43cb-921e-ef4b69aaf2f7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.697258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.698184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.698467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.698771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] PATH_INFO: `/v3/projects/d1892d1796394123a1f60c389706f560/users/5309e75ed2f248879bf49cfc350deecc/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.700725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1892d1796394123a1f60c389706f560, user_id=5309e75ed2f248879bf49cfc350deecc, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.704312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.714946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1011/2014] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:16:58 2021] PUT /identity/v3/projects/d1892d1796394123a1f60c389706f560/users/5309e75ed2f248879bf49cfc350deecc/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:16:58.726309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.726622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.726905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.755927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] MFA Rules not processed for user `5309e75ed2f248879bf49cfc350deecc`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:16:58.757193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:58.836392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1004/2015] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:16:58 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:16:58.846502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:16:58.849438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:16:58.910505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703864f-f819-4923-ad7a-fbeaf487bf64 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:16:58.914220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df18f67-72b6-4424-b3f3-de51cb212101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:16:58.914917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18f67-72b6-4424-b3f3-de51cb212101 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:16:58.915195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18f67-72b6-4424-b3f3-de51cb212101 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:16:58.915492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df18f67-72b6-4424-b3f3-de51cb212101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:16:58.925502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18f67-72b6-4424-b3f3-de51cb212101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:16:58.927015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df18f67-72b6-4424-b3f3-de51cb212101 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:16:58.937088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1012/2016] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:16:58 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:01.799519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:01.860699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa2fb8-12b4-40c0-9063-d1123f6fd3e7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:01.865514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:01.866386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:01.866694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:01.866968 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] PATH_INFO: `/v3/users/909386942ff846028fc70fe4f9693cdc` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:01.868228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] RBAC: Authorizing `identity:delete_user(user_id=909386942ff846028fc70fe4f9693cdc)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:01.870135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:02.102169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909386942ff846028fc70fe4f9693cdc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:02.102169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909386942ff846028fc70fe4f9693cdc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:02.219973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909386942ff846028fc70fe4f9693cdc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:02.227466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909386942ff846028fc70fe4f9693cdc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:02.228113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909386942ff846028fc70fe4f9693cdc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:02.233999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1005/2017] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:01 2021] DELETE /identity/v3/users/909386942ff846028fc70fe4f9693cdc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:02.239124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:02.239729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:02.239729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:02.258860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:02.260148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:02.324502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1013/2018] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:02.334931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:02.339955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:02.401234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50a38c-fdd8-4ee0-a2f8-e06682ed675b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:02.404590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:02.405251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:02.405537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:02.405815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:02.415613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:02.417234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:02.428111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1006/2019] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:03.018056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:03.019616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:03.032264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad844b-5af8-4eb8-a88f-1f50255776fa None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:03.037527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:03.038938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:03.039635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:03.046395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] PATH_INFO: `/v3/projects/fa566f160dfb43d8a97b07f53958a72e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:03.047927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa566f160dfb43d8a97b07f53958a72e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:03.049897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:03.172381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa566f160dfb43d8a97b07f53958a72e', 'request_id': 'req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.178695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa566f160dfb43d8a97b07f53958a72e', 'request_id': 'req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.364704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa566f160dfb43d8a97b07f53958a72e', 'request_id': 'req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.375941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] The token cache is being invalidate because project fa566f160dfb43d8a97b07f53958a72e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:03.376228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.376857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.378423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1014/2020] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:03 2021] DELETE /identity/v3/projects/fa566f160dfb43d8a97b07f53958a72e => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:03.382415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:03.393383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130b74b-9110-470c-960b-9c3ce781b904 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:03.451861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:03.452744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:03.453026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:03.453869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] PATH_INFO: `/v3/users/5309e75ed2f248879bf49cfc350deecc` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:03.455174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5309e75ed2f248879bf49cfc350deecc)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:03.457203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:03.700606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5309e75ed2f248879bf49cfc350deecc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.712645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5309e75ed2f248879bf49cfc350deecc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.795645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5309e75ed2f248879bf49cfc350deecc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.803501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5309e75ed2f248879bf49cfc350deecc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.804158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5309e75ed2f248879bf49cfc350deecc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:03.811228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1007/2021] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:03 2021] DELETE /identity/v3/users/5309e75ed2f248879bf49cfc350deecc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:04.294021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:04.294334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:04.307954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6703d1-1a1e-404e-b3df-3a60ac4342d0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:04.372904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:04.373771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.374060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.374345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] PATH_INFO: `/v3/projects/d1892d1796394123a1f60c389706f560` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.375692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1892d1796394123a1f60c389706f560)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:04.377641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:04.509055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1892d1796394123a1f60c389706f560', 'request_id': 'req-a1f87bc5-042d-4398-a4af-b24b6355415f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.515284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1892d1796394123a1f60c389706f560', 'request_id': 'req-a1f87bc5-042d-4398-a4af-b24b6355415f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.518140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:04.520071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:04.541195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf86b6-e651-4015-bf3b-4892c4b9d75e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:04.602149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1892d1796394123a1f60c389706f560', 'request_id': 'req-a1f87bc5-042d-4398-a4af-b24b6355415f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.602688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:04.603629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.603911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.604181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] PATH_INFO: `/v3/users/e38f3714822944d6802f38b3b267b5d6` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.605459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38f3714822944d6802f38b3b267b5d6)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:04.611953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:04.616476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] The token cache is being invalidate because project d1892d1796394123a1f60c389706f560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:04.616773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.617472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a1f87bc5-042d-4398-a4af-b24b6355415f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.619451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1015/2022] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:04 2021] DELETE /identity/v3/projects/d1892d1796394123a1f60c389706f560 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:04.626023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c35f-39fe-4644-ad66-e8c2de06bdae None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.626512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c35f-39fe-4644-ad66-e8c2de06bdae None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.627006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214c35f-39fe-4644-ad66-e8c2de06bdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.648521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f214c35f-39fe-4644-ad66-e8c2de06bdae None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:04.649735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f214c35f-39fe-4644-ad66-e8c2de06bdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:04.658595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1016/2023] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:04.666071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.666360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.668953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.684901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:04.686144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:04.695002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1017/2024] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:04.699169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:04.709770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d220930-4e19-4033-bac0-8d988df4f608 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:04.714496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:04.720628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.720628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.720628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.720628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:04.720628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:04.720628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:04.730508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1018/2025] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:17:04.735125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:04.744751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c848b0-3d93-4ed4-a999-79961f05301a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:04.749568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:04.750283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.750598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.750882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.751583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:04.753490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:04.847345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38f3714822944d6802f38b3b267b5d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.858814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38f3714822944d6802f38b3b267b5d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.873755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1019/2026] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:04 2021] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:04.879607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:04.935166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56835ea4-afb0-43ec-b857-2a9508561cbf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:04.940445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:04.945350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.945350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.945350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:04.945350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:04.945350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:04.964761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38f3714822944d6802f38b3b267b5d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.972496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38f3714822944d6802f38b3b267b5d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.977077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1e85117e-eaec-4616-92f1-c0620e43236e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38f3714822944d6802f38b3b267b5d6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:04.979909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1008/2027] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:04 2021] DELETE /identity/v3/users/e38f3714822944d6802f38b3b267b5d6 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:04.985037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:04.985382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:04.985658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.002858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:05.008598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:05.061877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1009/2028] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:05.070088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1020/2029] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:04 2021] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:05.071939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.073490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:05.074486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.076104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:05.087643 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effc294-644b-4cea-8342-3907cbbffba0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.092322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.092973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.093249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.093519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.095057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.096426 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.107229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1021/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:05.111019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.120808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c308498-ab21-4f9b-aa84-ed42e460f7cf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.125506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.126288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.126485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.126866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.127492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.129061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.132064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b8a38-1e86-4328-90b9-8ffec446e8ab None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.136064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62b5e-c692-4c0f-8af0-f3ee930c1b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.136719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62b5e-c692-4c0f-8af0-f3ee930c1b0f service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.146733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62b5e-c692-4c0f-8af0-f3ee930c1b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.146733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62b5e-c692-4c0f-8af0-f3ee930c1b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.146922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1022/2031] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:05.147026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62b5e-c692-4c0f-8af0-f3ee930c1b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.147726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62b5e-c692-4c0f-8af0-f3ee930c1b0f service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.149324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.157964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1010/2032] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:05.159084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a562a8-5c16-4a99-967a-c59f8589f426 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.163677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.164547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.164824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.165093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] PATH_INFO: `/v3/projects/4c2c135646cb47249a79d24349e20084/users/fbe3ea1ef3934b608e26954e3900670c/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.180718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2c135646cb47249a79d24349e20084, user_id=fbe3ea1ef3934b608e26954e3900670c, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.183583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.301898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1023/2033] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:05 2021] PUT /identity/v3/projects/4c2c135646cb47249a79d24349e20084/users/fbe3ea1ef3934b608e26954e3900670c/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:05.317137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.317566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.317964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.353942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] MFA Rules not processed for user `fbe3ea1ef3934b608e26954e3900670c`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:05.355225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:05.422985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1011/2034] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:05 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:05.429313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.495530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3eeb2-87af-4346-908f-a03cfdd398f0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.500797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.503432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.503432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.503432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.503432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.504645 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.618376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.619858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:05.635003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771d9d0f-9e53-49ae-b0c9-d2794ced109f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.640863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.641758 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.642031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.642303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] PATH_INFO: `/v3/projects/e73daf7afaa241418c048b6b390dec14` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.643537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e73daf7afaa241418c048b6b390dec14)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.645536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.647015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1024/2035] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:05 2021] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:05.652907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.712334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e84e26-fda9-48b8-bcd5-13b8b943ad3d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.717081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.717749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.718037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.718312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.719528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.721457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.772417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73daf7afaa241418c048b6b390dec14', 'request_id': 'req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:05.778430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73daf7afaa241418c048b6b390dec14', 'request_id': 'req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:05.790072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1025/2036] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:05 2021] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:05.794073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.804320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a09ed4-323f-46f2-abff-7a6c90eadbe3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.858036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.858733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.859020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.859296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.860608 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.862255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.869829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73daf7afaa241418c048b6b390dec14', 'request_id': 'req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:05.871958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1026/2037] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:05.876178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.881842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] The token cache is being invalidate because project e73daf7afaa241418c048b6b390dec14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:05.882250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:05.882990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:05.884713 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1012/2038] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:05 2021] DELETE /identity/v3/projects/e73daf7afaa241418c048b6b390dec14 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:05.888503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.889718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72da17-6c85-4d59-80d3-20f68537eb6f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.889835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:05.894494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.895407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.895685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.895956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] PATH_INFO: `/v3/projects/3dda87fa026d4f1f9be7e1e7d5a8e2d9/users/b0f35f0e62db4f0ab00fd2b0d6a6dc7c/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.902343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb41f7-8be0-42b6-b7af-e6a0ea6dc326 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:05.907627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:05.908503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:05.908781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:05.909052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] PATH_INFO: `/v3/users/9af748b09a2e4b849a77cdcc07794c0e` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:05.910235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9af748b09a2e4b849a77cdcc07794c0e)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.911901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dda87fa026d4f1f9be7e1e7d5a8e2d9, user_id=b0f35f0e62db4f0ab00fd2b0d6a6dc7c, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:05.912192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.914719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:05.989988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1027/2039] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:05 2021] PUT /identity/v3/projects/3dda87fa026d4f1f9be7e1e7d5a8e2d9/users/b0f35f0e62db4f0ab00fd2b0d6a6dc7c/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:05.994000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:05.995613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.056400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52a94-a4ba-4ea9-834b-c6e405ab5cb0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:06.061067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:06.061717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.061998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.062269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.063036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:06.064654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:06.074059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1028/2040] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:05 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:06.078717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:06.087780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87fa22a-7e65-4f99-b55a-71fbb32c7625 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:06.092416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b4b3b-83b6-4651-9529-06e85ce648b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:06.093248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4b3b-83b6-4651-9529-06e85ce648b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.093529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4b3b-83b6-4651-9529-06e85ce648b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.093861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b4b3b-83b6-4651-9529-06e85ce648b8 admin admin] PATH_INFO: `/v3/projects/3dda87fa026d4f1f9be7e1e7d5a8e2d9/users/b0f35f0e62db4f0ab00fd2b0d6a6dc7c/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.096288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4b3b-83b6-4651-9529-06e85ce648b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dda87fa026d4f1f9be7e1e7d5a8e2d9, user_id=b0f35f0e62db4f0ab00fd2b0d6a6dc7c, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:06.099006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b4b3b-83b6-4651-9529-06e85ce648b8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:06.104775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9af748b09a2e4b849a77cdcc07794c0e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.109525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1029/2041] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:06 2021] PUT /identity/v3/projects/3dda87fa026d4f1f9be7e1e7d5a8e2d9/users/b0f35f0e62db4f0ab00fd2b0d6a6dc7c/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:06.116945 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9af748b09a2e4b849a77cdcc07794c0e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.121078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.121370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.127085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.147771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] MFA Rules not processed for user `b0f35f0e62db4f0ab00fd2b0d6a6dc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:06.152174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.193288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9af748b09a2e4b849a77cdcc07794c0e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.200612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9af748b09a2e4b849a77cdcc07794c0e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.201350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9af748b09a2e4b849a77cdcc07794c0e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.207902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1013/2042] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:05 2021] DELETE /identity/v3/users/9af748b09a2e4b849a77cdcc07794c0e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:06.215493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1030/2043] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:06 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:06.226418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:06.227986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.284823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89571fe3-1e55-4692-9b8c-4a96ee544a8f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:06.288765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:06.289418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.289700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.290005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.348802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:06.349994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:06.359677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1014/2044] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:06 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:06.387268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:06.388718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.466934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6913f7a-0a82-4480-ab53-40f8cb2f0954 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:06.522412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:06.523415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.523765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.524115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] PATH_INFO: `/v3/users/fbe3ea1ef3934b608e26954e3900670c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.525985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe3ea1ef3934b608e26954e3900670c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:06.527971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:06.650064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:06.653023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.666928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af5162-ff46-4912-a244-05225b8939ca service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:06.671786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:06.672806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.673194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.673574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] PATH_INFO: `/v3/projects/0a7c437c623b43a2aaf77eb41826daaa` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.674905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7c437c623b43a2aaf77eb41826daaa)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:06.682473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:06.723439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe3ea1ef3934b608e26954e3900670c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.736105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe3ea1ef3934b608e26954e3900670c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.743148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe3ea1ef3934b608e26954e3900670c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.821827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7c437c623b43a2aaf77eb41826daaa', 'request_id': 'req-5dd32333-3684-47a8-adaf-a46762584fd5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.827856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7c437c623b43a2aaf77eb41826daaa', 'request_id': 'req-5dd32333-3684-47a8-adaf-a46762584fd5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.841453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe3ea1ef3934b608e26954e3900670c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.842072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98ffe1b8-7502-4da9-b74a-1ac0f0120916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe3ea1ef3934b608e26954e3900670c'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.849358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1031/2045] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:06 2021] DELETE /identity/v3/users/fbe3ea1ef3934b608e26954e3900670c => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:06.853837 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.854124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.854406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.872228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:06.873440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.939566 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1032/2046] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:06.947793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7c437c623b43a2aaf77eb41826daaa', 'request_id': 'req-5dd32333-3684-47a8-adaf-a46762584fd5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.948717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:06.949715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:06.959752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] The token cache is being invalidate because project 0a7c437c623b43a2aaf77eb41826daaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:06.960080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.960781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5dd32333-3684-47a8-adaf-a46762584fd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:06.962630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1015/2047] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:06 2021] DELETE /identity/v3/projects/0a7c437c623b43a2aaf77eb41826daaa => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:06.968113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9c5ff-3ea4-42bd-8320-f3d856c1deda None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:06.968404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9c5ff-3ea4-42bd-8320-f3d856c1deda None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:06.968680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9c5ff-3ea4-42bd-8320-f3d856c1deda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:06.990009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-82f9c5ff-3ea4-42bd-8320-f3d856c1deda None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:06.991422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-82f9c5ff-3ea4-42bd-8320-f3d856c1deda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.001747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1016/2048] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:07.008516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d118966-6784-4d42-b989-0ba17e45addf None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.009236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.009592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.009875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.012343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.012992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.013274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.013550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.015327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.027085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.027531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:07.028518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.028725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.036462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1017/2049] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:07.037848 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1033/2050] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:07.040785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.050013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2541-26d4-4444-adb4-55ebb80eb0ed None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.054572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.055310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.055592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.055865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.056593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:07.056903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.058466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.070096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1018/2051] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:17:07.074698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.084731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be33bd7e-4a1a-4782-b502-bc4d8216e872 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.089763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.090781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.090781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.091005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.091736 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.093667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.188449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1034/2052] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:07 2021] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:07.192613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.202428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9ae37-6d13-45cb-b048-d6d5d58baa7c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.257884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.258599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.258884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.259259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.260582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.262806 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.339030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1019/2053] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:07 2021] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:07.343314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.354701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd782218-2894-48de-a471-a4db28fb1c55 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.360003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.360685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.360962 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.361360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.362093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.363989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.374768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1035/2054] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:07.378933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.389041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa0f32-ecea-4d91-bb62-5e905cc20abc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.393799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.401608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.401608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.401608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.401608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.401608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.409940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1020/2055] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:07.414195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.424823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f833332-4af1-4dd5-b564-81ffb307e96d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.429562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ed658-303b-4bff-87df-9d2c456a3d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.430436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ed658-303b-4bff-87df-9d2c456a3d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.430747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ed658-303b-4bff-87df-9d2c456a3d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.431048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ed658-303b-4bff-87df-9d2c456a3d13 admin admin] PATH_INFO: `/v3/projects/70d5ee77aba948ae9deb6a58b5ffc924/users/a4635847a84340c6a150f696cea1bcc7/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.446197 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ed658-303b-4bff-87df-9d2c456a3d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d5ee77aba948ae9deb6a58b5ffc924, user_id=a4635847a84340c6a150f696cea1bcc7, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.448922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ed658-303b-4bff-87df-9d2c456a3d13 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.483320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.485082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.498318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bff94f-1139-4b19-8bbf-59f40efb0e66 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.503682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.503955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.504207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.504481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] PATH_INFO: `/v3/projects/4c2c135646cb47249a79d24349e20084` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.505711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2c135646cb47249a79d24349e20084)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.507651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.558787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1036/2056] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:07 2021] PUT /identity/v3/projects/70d5ee77aba948ae9deb6a58b5ffc924/users/a4635847a84340c6a150f696cea1bcc7/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:07.569797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.570084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.570358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.597614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] MFA Rules not processed for user `a4635847a84340c6a150f696cea1bcc7`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:07.598928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.615771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2c135646cb47249a79d24349e20084', 'request_id': 'req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:07.623153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2c135646cb47249a79d24349e20084', 'request_id': 'req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:07.662887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1037/2057] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:07 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:07.667132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.704872 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2c135646cb47249a79d24349e20084', 'request_id': 'req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:07.715835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] The token cache is being invalidate because project 4c2c135646cb47249a79d24349e20084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:07.716123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:07.716756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:07.718435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1021/2058] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:07 2021] DELETE /identity/v3/projects/4c2c135646cb47249a79d24349e20084 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:07.723168 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.724454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.725433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c347a-daaf-4612-b8d2-6388fac17da7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.779828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.780490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.780771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.781043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.782289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.786030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.795669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0bb0c-d166-4ddd-ab16-b5491b19c3bc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.800679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.801554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.801831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.802099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] PATH_INFO: `/v3/users/b0f35f0e62db4f0ab00fd2b0d6a6dc7c` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.803304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f35f0e62db4f0ab00fd2b0d6a6dc7c)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.805306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.883788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1038/2059] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:07 2021] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:07.887895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:07.889441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:07.948917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e9d93-58d6-4f5f-a9f9-f7eb19ad6081 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:07.954066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:07.954781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:07.955113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:07.955334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:07.956003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:07.957936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:07.980734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f35f0e62db4f0ab00fd2b0d6a6dc7c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:07.992438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f35f0e62db4f0ab00fd2b0d6a6dc7c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.053474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1039/2060] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:07 2021] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:08.057435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.067655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e9650-c429-4eed-aa3d-e367521e3efa admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.072367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.073018 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.073190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f35f0e62db4f0ab00fd2b0d6a6dc7c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.073293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.073555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.074270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.077120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.081458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f35f0e62db4f0ab00fd2b0d6a6dc7c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.082209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f35f0e62db4f0ab00fd2b0d6a6dc7c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.088369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1022/2061] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:07 2021] DELETE /identity/v3/users/b0f35f0e62db4f0ab00fd2b0d6a6dc7c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:08.093978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1040/2062] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:08 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:08.095022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.096388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.160862 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaceb04-c730-456d-9828-0db528083157 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.165917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.166839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.167118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.167390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] PATH_INFO: `/v3/projects/ac0dea39f8e24a0d86c03e2ddc59ca3f/users/d9e96af9a3944990aafa7ba1323098f1/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.181269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0dea39f8e24a0d86c03e2ddc59ca3f, user_id=d9e96af9a3944990aafa7ba1323098f1, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.183955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.253318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1023/2063] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:08 2021] PUT /identity/v3/projects/ac0dea39f8e24a0d86c03e2ddc59ca3f/users/d9e96af9a3944990aafa7ba1323098f1/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:08.257387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.267719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09903b77-4db0-4b38-ad3f-99bc82685bab admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.323578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4a209-64c2-45fa-8fde-b34ea85055e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.324254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a209-64c2-45fa-8fde-b34ea85055e9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.324537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a209-64c2-45fa-8fde-b34ea85055e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.324816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4a209-64c2-45fa-8fde-b34ea85055e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.325548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4a209-64c2-45fa-8fde-b34ea85055e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.327219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4a209-64c2-45fa-8fde-b34ea85055e9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.337985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1041/2064] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:08 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:08.341398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.352277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad18fd1-3315-49d0-9c30-5972b9b89294 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.357592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.358525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.358849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.359123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] PATH_INFO: `/v3/projects/ac0dea39f8e24a0d86c03e2ddc59ca3f/users/d9e96af9a3944990aafa7ba1323098f1/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.361583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0dea39f8e24a0d86c03e2ddc59ca3f, user_id=d9e96af9a3944990aafa7ba1323098f1, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.364530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.374775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1024/2065] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:08 2021] PUT /identity/v3/projects/ac0dea39f8e24a0d86c03e2ddc59ca3f/users/d9e96af9a3944990aafa7ba1323098f1/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:08.385428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.385722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.386131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.416109 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] MFA Rules not processed for user `d9e96af9a3944990aafa7ba1323098f1`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:08.419770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.487528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1042/2066] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:08 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:08.498283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.500725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.537502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.537502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.562429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8838b-0760-4125-a881-f473a9a72851 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.566849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.567495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.567773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.568042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.576967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.578494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.587694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1025/2067] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:08 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:08.604849 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ebea94-82cd-4dcb-b6d2-a4114e067e9b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.609572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.611007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.611239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.611533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] PATH_INFO: `/v3/projects/3dda87fa026d4f1f9be7e1e7d5a8e2d9` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.612685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dda87fa026d4f1f9be7e1e7d5a8e2d9)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.617800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.713243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.722120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182c48c-de18-4a55-aead-c7b83b7d5cbb service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:08.725784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:08.726409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.726718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.726988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.728834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.760651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dda87fa026d4f1f9be7e1e7d5a8e2d9', 'request_id': 'req-667fab39-5b71-46bd-abc7-5449d6d0b10e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.767168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dda87fa026d4f1f9be7e1e7d5a8e2d9', 'request_id': 'req-667fab39-5b71-46bd-abc7-5449d6d0b10e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.803176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:08.805072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ed25f-f15b-49b1-a322-221a3f15f2c4 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:08.814487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1026/2068] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:08 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:08.859040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dda87fa026d4f1f9be7e1e7d5a8e2d9', 'request_id': 'req-667fab39-5b71-46bd-abc7-5449d6d0b10e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.874359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] The token cache is being invalidate because project 3dda87fa026d4f1f9be7e1e7d5a8e2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:08.874827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.875635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-667fab39-5b71-46bd-abc7-5449d6d0b10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:08.877574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1043/2069] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:08 2021] DELETE /identity/v3/projects/3dda87fa026d4f1f9be7e1e7d5a8e2d9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:08.883325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.883685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.884032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.903518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:08.904784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.968632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1027/2070] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:08.977967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:08.978261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:08.978540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:08.992373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:08.993935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:08.998175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:08.999499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:09.005905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b7faa-9b54-4077-a5d2-513056acc118 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.014077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.014252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1044/2071] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:09.014403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.014403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.014403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] PATH_INFO: `/v3/users/a4635847a84340c6a150f696cea1bcc7` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.014403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4635847a84340c6a150f696cea1bcc7)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.015457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.015585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.026096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76a92c-04db-4ea0-a84f-fb3e8f827e19 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.032086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.033327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.033327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.033532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.034187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:09.034481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.036107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.047860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1045/2072] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:17:09.052157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.061543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a84533-31a5-43d4-b402-a6d44e2096d4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.068720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.068720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.068720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.068720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.069126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.069752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.174984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1046/2073] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:09 2021] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:09.179114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.205757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4635847a84340c6a150f696cea1bcc7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:09.218646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4635847a84340c6a150f696cea1bcc7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:09.242747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959eaf7-cecf-4a18-bf59-f6dd99718a48 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.247561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.248236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.248526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.248832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.249560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.251570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.333447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4635847a84340c6a150f696cea1bcc7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:09.339526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1047/2074] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:09 2021] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:09.344229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4635847a84340c6a150f696cea1bcc7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:09.344229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b68d5c-737e-45dd-942b-229fd3cf1a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4635847a84340c6a150f696cea1bcc7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:09.344413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.345512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:09.348356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1028/2075] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:08 2021] DELETE /identity/v3/users/a4635847a84340c6a150f696cea1bcc7 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:09.352525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.352985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.353214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.357765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e834-327c-469f-a154-da88a90b20d9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.370843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:09.375808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:09.414692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.415510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.415789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.416064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.421642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.421642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.428110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1048/2076] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:09 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:09.432653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1029/2077] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:09.432818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.440072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.441469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:09.442843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f8e2-d0f8-4357-918d-6b824101bfae admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.447537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.452216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.452216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.452216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.452216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.452216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.462218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1049/2078] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:09.466143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.475572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b5fd5-c9e3-4cee-88b2-68e4a7fdea4a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.480172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.481037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.481318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.481592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] PATH_INFO: `/v3/projects/f962bb35e06a4a79b0063a5bd5d1f3a7/users/f288344ec8774339a1e48eea6a523aaf/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.496588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f962bb35e06a4a79b0063a5bd5d1f3a7, user_id=f288344ec8774339a1e48eea6a523aaf, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.497913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa673b6-4476-438f-ae78-ae016697ff6b None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.499561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.502641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6d08-00ce-48db-a521-e191faf883b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.503467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6d08-00ce-48db-a521-e191faf883b4 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.503981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6d08-00ce-48db-a521-e191faf883b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.504280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6d08-00ce-48db-a521-e191faf883b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.513637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d6d08-00ce-48db-a521-e191faf883b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.515106 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d6d08-00ce-48db-a521-e191faf883b4 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.525766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1030/2079] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:09.622940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1050/2080] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:09 2021] PUT /identity/v3/projects/f962bb35e06a4a79b0063a5bd5d1f3a7/users/f288344ec8774339a1e48eea6a523aaf/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:09.627667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.627961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.628244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.658653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] MFA Rules not processed for user `f288344ec8774339a1e48eea6a523aaf`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:09.658653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:09.720899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1031/2081] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:09 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:09.725083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.807605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588bfc3-497d-461e-8f4c-2938dfb801b7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:09.827364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:09.828050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:09.828367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:09.828639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:09.829416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:09.836387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:09.931875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1051/2082] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:09 2021] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:09.935030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:09.945845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5719cf-b0d4-467a-9f46-d4f299a1aa50 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.018454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.019185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.019504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.019735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.020454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.022371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.056692 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.058560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:10.074010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599d156-1bae-4d4e-b8ff-b4b2da97603e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.080622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.081514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.081803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.082229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] PATH_INFO: `/v3/projects/70d5ee77aba948ae9deb6a58b5ffc924` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.089258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d5ee77aba948ae9deb6a58b5ffc924)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.089258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.125594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1032/2083] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:09 2021] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:10.126546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.146683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8926ba1-5ec1-454a-ad26-dc901e87a03c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.151981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.152974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.153145 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.153512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.154525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.156369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.168407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1033/2084] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:10 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:10.172242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.181933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2255792d-7060-4259-9255-96a562c8cc75 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.186653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.188061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.188343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.188639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] PATH_INFO: `/v3/projects/30891d51702a49aaa6702535124f7109/users/28c0e312ac95466bb0bc71cb7e8dd45a/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.204630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30891d51702a49aaa6702535124f7109, user_id=28c0e312ac95466bb0bc71cb7e8dd45a, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.207261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d5ee77aba948ae9deb6a58b5ffc924', 'request_id': 'req-96fa87ff-2415-4ab6-a707-f10603e009a3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.207674 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.214680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d5ee77aba948ae9deb6a58b5ffc924', 'request_id': 'req-96fa87ff-2415-4ab6-a707-f10603e009a3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.276230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1034/2085] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:10 2021] PUT /identity/v3/projects/30891d51702a49aaa6702535124f7109/users/28c0e312ac95466bb0bc71cb7e8dd45a/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:10.280114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.299104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d5ee77aba948ae9deb6a58b5ffc924', 'request_id': 'req-96fa87ff-2415-4ab6-a707-f10603e009a3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.310894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] The token cache is being invalidate because project 70d5ee77aba948ae9deb6a58b5ffc924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:10.311384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.312196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.314663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1052/2086] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:10 2021] DELETE /identity/v3/projects/70d5ee77aba948ae9deb6a58b5ffc924 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:10.318458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.319853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:10.342650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb36b1-636d-47b9-be35-1213d2d81522 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.347503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.348173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.348458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.348749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.349457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.351086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.361816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1035/2087] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:10 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:10.365577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.367536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:10.380907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b93d6-c6e7-4714-ab97-3c2535c4889c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.386097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b058ca-e71c-49bf-8926-a0b8529757c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.387045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b058ca-e71c-49bf-8926-a0b8529757c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.387440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b058ca-e71c-49bf-8926-a0b8529757c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.387723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b058ca-e71c-49bf-8926-a0b8529757c9 admin admin] PATH_INFO: `/v3/projects/30891d51702a49aaa6702535124f7109/users/28c0e312ac95466bb0bc71cb7e8dd45a/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.387884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa87ff-2415-4ab6-a707-f10603e009a3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.393122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.393999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.394285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.394562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] PATH_INFO: `/v3/users/d9e96af9a3944990aafa7ba1323098f1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.395826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e96af9a3944990aafa7ba1323098f1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.397765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.399202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b058ca-e71c-49bf-8926-a0b8529757c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30891d51702a49aaa6702535124f7109, user_id=28c0e312ac95466bb0bc71cb7e8dd45a, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.402108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b058ca-e71c-49bf-8926-a0b8529757c9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.413128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1036/2088] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:10 2021] PUT /identity/v3/projects/30891d51702a49aaa6702535124f7109/users/28c0e312ac95466bb0bc71cb7e8dd45a/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:10.425388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16236-a951-468f-989c-b025d8756e79 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.425727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16236-a951-468f-989c-b025d8756e79 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.425960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16236-a951-468f-989c-b025d8756e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.454894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-77c16236-a951-468f-989c-b025d8756e79 None None] MFA Rules not processed for user `28c0e312ac95466bb0bc71cb7e8dd45a`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:10.456105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-77c16236-a951-468f-989c-b025d8756e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:10.523685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1037/2089] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:10 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:10.537571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16236-a951-468f-989c-b025d8756e79 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:10.539122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-77c16236-a951-468f-989c-b025d8756e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:10.596139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16236-a951-468f-989c-b025d8756e79 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:10.600139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:10.600789 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:10.601136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:10.603571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:10.603571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:10.613133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e96af9a3944990aafa7ba1323098f1'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.624915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e96af9a3944990aafa7ba1323098f1'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.632233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e96af9a3944990aafa7ba1323098f1'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.660970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:10.662438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:10.672420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1038/2090] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:10 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:10.707779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e96af9a3944990aafa7ba1323098f1'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.708409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-321272e9-641c-4156-9801-2aa8579cfe46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e96af9a3944990aafa7ba1323098f1'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:10.716321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1053/2091] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:10 2021] DELETE /identity/v3/users/d9e96af9a3944990aafa7ba1323098f1 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:11.227210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:11.300265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20fcbb-e011-46b4-9d03-30c36f695c40 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:11.364452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:11.365321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:11.365604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:11.365987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] PATH_INFO: `/v3/projects/ac0dea39f8e24a0d86c03e2ddc59ca3f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:11.367098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0dea39f8e24a0d86c03e2ddc59ca3f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:11.369046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:11.557340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0dea39f8e24a0d86c03e2ddc59ca3f', 'request_id': 'req-29913767-6b43-49aa-9916-0407c9816c90'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:11.564137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0dea39f8e24a0d86c03e2ddc59ca3f', 'request_id': 'req-29913767-6b43-49aa-9916-0407c9816c90'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:11.633539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0dea39f8e24a0d86c03e2ddc59ca3f', 'request_id': 'req-29913767-6b43-49aa-9916-0407c9816c90'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:11.644507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] The token cache is being invalidate because project ac0dea39f8e24a0d86c03e2ddc59ca3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:11.644801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:11.645443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-29913767-6b43-49aa-9916-0407c9816c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:11.647236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1039/2092] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:11 2021] DELETE /identity/v3/projects/ac0dea39f8e24a0d86c03e2ddc59ca3f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:11.654198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:11.654741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:11.654858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:11.673887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:11.675104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:11.735533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1054/2093] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:11.743956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:11.744246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:11.744523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:11.762630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:11.764036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:11.772061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1040/2094] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:11.776268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:11.786251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f7dba-f378-4441-b948-af6e2409440d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:11.791026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:11.791682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:11.791966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:11.792239 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:11.792966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:11.793272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:11.794899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:11.806992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1055/2095] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:17:11.811387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:11.820763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c8ce9-dbbc-4095-bcea-a0183e6faee6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:11.825502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:11.826178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:11.826462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:11.826775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:11.827494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:11.829407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:11.943590 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1041/2096] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:11 2021] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:11.947738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:11.958388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ee65-558d-42c6-88a7-ff0507a12ffb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:12.013603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:12.014268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:12.014558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:12.014864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:12.015558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:12.017964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:12.070435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1056/2097] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:11 2021] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:12.074624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:12.085797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb8c3a-f844-43b7-b13d-df794567371b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:12.090682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:12.091368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:12.091655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:12.091934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:12.092662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:12.095697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:12.109578 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1042/2098] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:12.110687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:12.120998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1297f3bb-7dbd-4e91-93db-ae78b3da4999 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:12.129104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe861b0-dbe6-4f4a-abc7-86c26636082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:12.133976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe861b0-dbe6-4f4a-abc7-86c26636082c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:12.133976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe861b0-dbe6-4f4a-abc7-86c26636082c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:12.133976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe861b0-dbe6-4f4a-abc7-86c26636082c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:12.133976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe861b0-dbe6-4f4a-abc7-86c26636082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:12.133976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe861b0-dbe6-4f4a-abc7-86c26636082c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:12.143704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1057/2099] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:12.147902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:12.162873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c63fc-5249-43d4-bf7e-bb108545d30f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:12.167632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:12.168516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:12.168824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:12.169079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] PATH_INFO: `/v3/projects/2a92cf3decdb4b6a9877dfb5571fe283/users/8300d6c2e73546c2b75370732e89d434/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:12.184727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a92cf3decdb4b6a9877dfb5571fe283, user_id=8300d6c2e73546c2b75370732e89d434, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:12.187323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:12.311018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1043/2100] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:12 2021] PUT /identity/v3/projects/2a92cf3decdb4b6a9877dfb5571fe283/users/8300d6c2e73546c2b75370732e89d434/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:12.322538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:12.322858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:12.323200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:12.350792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] MFA Rules not processed for user `8300d6c2e73546c2b75370732e89d434`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:12.352146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:12.433170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1058/2101] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:12.443953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:12.445603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:12.511630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193365c-547e-4aeb-a97a-c763535053ae admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:12.516579 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:12.521552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:12.521552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:12.521552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:12.542075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:12.543574 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:12.552545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1044/2102] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:12 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:18.555836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:18.558036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:18.568814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfbdc27-ba54-40a6-a512-130652ca62e8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:18.572403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:18.573028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:18.573304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:18.573573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:18.575341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:18.634309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:18.635906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57ef03-e90e-4800-aa02-cb562f697fa1 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:18.645213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1059/2103] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:18 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:22.485716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:22.552532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f030a-6b8c-40c5-9b06-80e842595859 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:22.557273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:22.558237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:22.558515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:22.558820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] PATH_INFO: `/v3/users/8300d6c2e73546c2b75370732e89d434` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:22.560037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8300d6c2e73546c2b75370732e89d434)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:22.561959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:22.755981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8300d6c2e73546c2b75370732e89d434'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:22.769110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8300d6c2e73546c2b75370732e89d434'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:22.853656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8300d6c2e73546c2b75370732e89d434'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:22.862037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8300d6c2e73546c2b75370732e89d434'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:22.863154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8300d6c2e73546c2b75370732e89d434'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:22.868836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1045/2104] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:22 2021] DELETE /identity/v3/users/8300d6c2e73546c2b75370732e89d434 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:22.873338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:22.873817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:22.874089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:22.891777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:22.892973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:22.952715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1060/2105] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:22.962783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:22.964191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:23.021688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7fb010-941a-4ced-93f6-f41cc9ec67f0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:23.025627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:23.026329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:23.026639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:23.026919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:23.036353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:23.037786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:23.047763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1046/2106] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:23.619028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:23.620753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:23.632795 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3dd79a-7f7a-4410-ba26-0ffceeb6294a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:23.648520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:23.648520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:23.648520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:23.648520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] PATH_INFO: `/v3/projects/2a92cf3decdb4b6a9877dfb5571fe283` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:23.649136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a92cf3decdb4b6a9877dfb5571fe283)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:23.651164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:23.794939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a92cf3decdb4b6a9877dfb5571fe283', 'request_id': 'req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:23.801513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a92cf3decdb4b6a9877dfb5571fe283', 'request_id': 'req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:23.887952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a92cf3decdb4b6a9877dfb5571fe283', 'request_id': 'req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:23.899936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] The token cache is being invalidate because project 2a92cf3decdb4b6a9877dfb5571fe283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:23.900230 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:23.900902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f767917a-a6f8-42ab-96b3-bb2d4b7806d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:23.902609 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1061/2107] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:23 2021] DELETE /identity/v3/projects/2a92cf3decdb4b6a9877dfb5571fe283 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:24.201333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:24.202812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:24.216455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9247cc1-3df9-40fa-80ce-225f85a5f366 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:24.277273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:24.278152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:24.278437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:24.278743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] PATH_INFO: `/v3/users/6bbe3fcb4414452b893b9851d526e82d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:24.279931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbe3fcb4414452b893b9851d526e82d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:24.282568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:24.540409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbe3fcb4414452b893b9851d526e82d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:24.561633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbe3fcb4414452b893b9851d526e82d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:24.668088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbe3fcb4414452b893b9851d526e82d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:24.685054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbe3fcb4414452b893b9851d526e82d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:24.685769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbe3fcb4414452b893b9851d526e82d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:24.691941 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1047/2108] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:24 2021] DELETE /identity/v3/users/6bbe3fcb4414452b893b9851d526e82d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:24.698147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:24.698524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:24.698948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:24.718501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:24.720383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:24.779503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1062/2109] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:24.789238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:24.790651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:24.850884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0232a4-2460-40d7-85d6-4d9f33741437 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:24.854422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:24.855248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:24.855529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:24.855802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:24.865096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:24.866523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:24.876178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1048/2110] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:25.355470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:25.356915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:25.372445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0341b22-451c-4902-83f1-d6bb33e7a671 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:25.379422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:25.380434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:25.380888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:25.381177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] PATH_INFO: `/v3/projects/7e962f769aed4f348c5bccaa40a7ad50` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:25.382394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e962f769aed4f348c5bccaa40a7ad50)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:25.384552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:25.513302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e962f769aed4f348c5bccaa40a7ad50', 'request_id': 'req-77630772-210f-4049-8282-84d74d9e5aec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:25.525582 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e962f769aed4f348c5bccaa40a7ad50', 'request_id': 'req-77630772-210f-4049-8282-84d74d9e5aec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:25.613935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e962f769aed4f348c5bccaa40a7ad50', 'request_id': 'req-77630772-210f-4049-8282-84d74d9e5aec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:25.625826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] The token cache is being invalidate because project 7e962f769aed4f348c5bccaa40a7ad50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:25.626122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:25.626818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-77630772-210f-4049-8282-84d74d9e5aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:25.628368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1063/2111] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:25 2021] DELETE /identity/v3/projects/7e962f769aed4f348c5bccaa40a7ad50 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:25.632312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:25.642403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c892b-36c6-429e-9c8a-242d1eb9674d service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:25.706495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:25.707424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:25.707705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:25.707983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] PATH_INFO: `/v3/users/d8f51118e05a40be830dee582227a5db` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:25.709378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f51118e05a40be830dee582227a5db)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:25.711506 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:25.727118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:25.727669 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:25.728118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:25.748165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] MFA Rules not processed for user `4c80843a900943ecb7d312088d9bf04b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:25.749375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:25.805283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1064/2112] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:25 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:25.967400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f51118e05a40be830dee582227a5db'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:25.980231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f51118e05a40be830dee582227a5db'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.065403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f51118e05a40be830dee582227a5db'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.073319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f51118e05a40be830dee582227a5db'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.074013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-914a67a2-28ec-4c3b-92a7-0a3d11322629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f51118e05a40be830dee582227a5db'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.081356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1049/2113] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:25 2021] DELETE /identity/v3/users/d8f51118e05a40be830dee582227a5db => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:26.642417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:26.644534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:26.674951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a63e6-cd65-46a5-949d-6e7641cf5023 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:26.732363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:26.733225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:26.733541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:26.733818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] PATH_INFO: `/v3/projects/a3423b9e3b444f388ca392938fba4383` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:26.735632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3423b9e3b444f388ca392938fba4383)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:26.737578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:26.842459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3423b9e3b444f388ca392938fba4383', 'request_id': 'req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.848772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3423b9e3b444f388ca392938fba4383', 'request_id': 'req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.933503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3423b9e3b444f388ca392938fba4383', 'request_id': 'req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.945336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] The token cache is being invalidate because project a3423b9e3b444f388ca392938fba4383 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:26.945709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.946419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:26.948076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1065/2114] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:26 2021] DELETE /identity/v3/projects/a3423b9e3b444f388ca392938fba4383 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:26.953696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ed61-29dd-49eb-91f5-f512191395a0 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:26.954183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ed61-29dd-49eb-91f5-f512191395a0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:26.954365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168ed61-29dd-49eb-91f5-f512191395a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:26.973316 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c168ed61-29dd-49eb-91f5-f512191395a0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:26.974036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:26.974721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c168ed61-29dd-49eb-91f5-f512191395a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:26.975424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.037542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1050/2115] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:27.044830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.045117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.045632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.046203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e0f29-8a12-4b5f-9e2f-5c771b8bf097 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.051498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.052415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.052721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.052975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] PATH_INFO: `/v3/users/f288344ec8774339a1e48eea6a523aaf` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.054184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f288344ec8774339a1e48eea6a523aaf)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.056150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.065734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:27.066956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.074842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1051/2116] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:27.079235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.087980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8029ba-b1e9-40b7-ac06-54eb412002bc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.092497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.093144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.093422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.093730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.094996 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:27.095297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.096861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.108189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1052/2117] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:17:27.148119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.158028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abed110-b0e7-458a-b957-8f40ca9c4bbd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.163261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.163982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.164313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.164611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.168160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.168160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.321617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1053/2118] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:27 2021] POST /identity/v3/projects => generated 399 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:27.325339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.329945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f288344ec8774339a1e48eea6a523aaf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:27.341510 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f288344ec8774339a1e48eea6a523aaf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:27.349114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f288344ec8774339a1e48eea6a523aaf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:27.388125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a4145-1eed-49b4-ab9a-0dd0c531b79e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.393525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.394190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.394469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.394769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.395442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.397398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.411019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f288344ec8774339a1e48eea6a523aaf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:27.411725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-fbc7a4db-0323-4e55-b8ea-dfcf4af03225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f288344ec8774339a1e48eea6a523aaf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:27.418340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1066/2119] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:26 2021] DELETE /identity/v3/users/f288344ec8774339a1e48eea6a523aaf => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:27.422935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.423222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.423499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.439934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:27.441123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.500670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1067/2120] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:27.510622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1054/2121] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:27 2021] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:27.512016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.515149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.515307 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.517889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.542241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7bf5c-3899-4dc8-bf24-c2784d171d94 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.547522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.548401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.548564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.549029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.549825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.551594 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.562219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1055/2122] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:27 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:27.566011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.577723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e889255-86ec-4ea2-997c-d6ffc0d511ee admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.585524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257b19-076f-414b-b6c4-68160276bbfb None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.589718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.589824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b9838-5bca-40e3-a46b-def7ea4409f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.590299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b9838-5bca-40e3-a46b-def7ea4409f5 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.590410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.590569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b9838-5bca-40e3-a46b-def7ea4409f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.590687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.590879 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.591062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b9838-5bca-40e3-a46b-def7ea4409f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.591681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.593707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.602737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b9838-5bca-40e3-a46b-def7ea4409f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.604382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b9838-5bca-40e3-a46b-def7ea4409f5 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.609265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1056/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:27 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:27.613678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.625820 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1068/2124] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:27.627522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5acb69-f9c0-4443-813e-06716fa7ba97 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.640581 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:27.640581 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.640581 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.640581 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] PATH_INFO: `/v3/projects/fef37d0d6c6748308919bbed9fee3979/users/40544e66e21f47cb9bde4dd8320059fd/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.654352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef37d0d6c6748308919bbed9fee3979, user_id=40544e66e21f47cb9bde4dd8320059fd, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:27.657946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:27.759550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1057/2125] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:27 2021] PUT /identity/v3/projects/fef37d0d6c6748308919bbed9fee3979/users/40544e66e21f47cb9bde4dd8320059fd/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:27.772198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:27.772670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:27.772762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:27.801782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] MFA Rules not processed for user `40544e66e21f47cb9bde4dd8320059fd`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:27.803029 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.876233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.878160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:27.882403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1069/2126] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:27 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:27.899816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:27.992788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a4240e-43ae-49a5-8508-e389e2898184 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.998012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbbae-b6e1-4e46-a1ef-d899aa82a54e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:27.999192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.000220 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.000573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.000973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] PATH_INFO: `/v3/users/bcbade6ae0304c0eaa229935fc60ed3a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.002239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbade6ae0304c0eaa229935fc60ed3a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.003948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.004462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.004626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.005494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.005784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.006511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.008672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.078013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1070/2127] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:27 2021] POST /identity/v3/projects => generated 399 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:28.082505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.152351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae9c72-f23f-45b4-8aa2-48eb93463976 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.153220 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbade6ae0304c0eaa229935fc60ed3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.157791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.158466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.158772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.159081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.159802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.161743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.169885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbade6ae0304c0eaa229935fc60ed3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.283511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1071/2128] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:28 2021] POST /identity/v3/users => generated 306 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:28.283511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.283511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.294808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2d9b4-41e5-44dc-8052-5718bb8cd542 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.299559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.300379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.300661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.300936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] PATH_INFO: `/v3/projects/f962bb35e06a4a79b0063a5bd5d1f3a7` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.302077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f962bb35e06a4a79b0063a5bd5d1f3a7)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.304168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.304822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbade6ae0304c0eaa229935fc60ed3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.312336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbade6ae0304c0eaa229935fc60ed3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.313019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbade6ae0304c0eaa229935fc60ed3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.318845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1058/2129] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:27 2021] DELETE /identity/v3/users/bcbade6ae0304c0eaa229935fc60ed3a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:28.319629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.320962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.383865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb91959-1066-4f91-bdb7-6218f2bbb63f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.388556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05868921-d419-4074-84dc-fb9d367cdccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.389230 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05868921-d419-4074-84dc-fb9d367cdccf admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.389513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05868921-d419-4074-84dc-fb9d367cdccf admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.389786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05868921-d419-4074-84dc-fb9d367cdccf admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.390510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05868921-d419-4074-84dc-fb9d367cdccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.392622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05868921-d419-4074-84dc-fb9d367cdccf admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.402183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1059/2130] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:28 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:28.402183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.402183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.402183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.418123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f962bb35e06a4a79b0063a5bd5d1f3a7', 'request_id': 'req-164dc82a-5072-402b-82e5-6646d77dad39'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.421567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:28.422842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.424774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f962bb35e06a4a79b0063a5bd5d1f3a7', 'request_id': 'req-164dc82a-5072-402b-82e5-6646d77dad39'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.479700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1060/2131] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:28.480600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.490419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919deb2-3451-4c96-b2ca-a7c3fe176523 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.495180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.496066 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.496358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.496624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] PATH_INFO: `/v3/projects/35a7e1a54bd1423c81ddfe0695749650/users/a96adbcd7fff4ab5a9ec733220973a24/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.511630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a7e1a54bd1423c81ddfe0695749650, user_id=a96adbcd7fff4ab5a9ec733220973a24, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.514323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.536468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f962bb35e06a4a79b0063a5bd5d1f3a7', 'request_id': 'req-164dc82a-5072-402b-82e5-6646d77dad39'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.547160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] The token cache is being invalidate because project f962bb35e06a4a79b0063a5bd5d1f3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:28.547446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.548083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:28.549630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1072/2132] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:28 2021] DELETE /identity/v3/projects/f962bb35e06a4a79b0063a5bd5d1f3a7 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:28.553066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.554383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.609727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164dc82a-5072-402b-82e5-6646d77dad39 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.613547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.614204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.614749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.615039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.616873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.629315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1061/2133] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:28 2021] PUT /identity/v3/projects/35a7e1a54bd1423c81ddfe0695749650/users/a96adbcd7fff4ab5a9ec733220973a24/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:28.630416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.632746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.632859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.632937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.648243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1073/2134] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:28.648990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.650261 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.664983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bce5ce-d7ee-4e88-80d7-5201213078a3 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.710614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d116-1a2f-424c-aaa4-6d325255fd64 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.729325 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.730243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.736092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.736092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] PATH_INFO: `/v3/users/28c0e312ac95466bb0bc71cb7e8dd45a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.736092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c0e312ac95466bb0bc71cb7e8dd45a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.736092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.749943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.752392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.752828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.753593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.754511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.757351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.771398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1074/2135] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:28 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:28.775624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.798155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3678aa-ede0-4914-8304-12012943cfb9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:28.805340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963abd75-e6ba-4668-9527-e6d216344368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:28.806451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abd75-e6ba-4668-9527-e6d216344368 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.806938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abd75-e6ba-4668-9527-e6d216344368 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.807411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963abd75-e6ba-4668-9527-e6d216344368 admin admin] PATH_INFO: `/v3/projects/35a7e1a54bd1423c81ddfe0695749650/users/a96adbcd7fff4ab5a9ec733220973a24/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.809984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963abd75-e6ba-4668-9527-e6d216344368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a7e1a54bd1423c81ddfe0695749650, user_id=a96adbcd7fff4ab5a9ec733220973a24, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:28.813486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963abd75-e6ba-4668-9527-e6d216344368 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:28.832269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1075/2136] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:28 2021] PUT /identity/v3/projects/35a7e1a54bd1423c81ddfe0695749650/users/a96adbcd7fff4ab5a9ec733220973a24/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:28.837749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:28.838173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:28.838465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:28.872739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] MFA Rules not processed for user `a96adbcd7fff4ab5a9ec733220973a24`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:28.874869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:28.967985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1076/2137] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:28 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:28.978817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:28.980435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:29.011211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c0e312ac95466bb0bc71cb7e8dd45a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.025866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c0e312ac95466bb0bc71cb7e8dd45a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.048641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0412e813-15af-43ca-b774-8caea7df85e2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:29.052292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:29.052925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:29.058335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:29.058335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:29.062065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:29.064125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:29.073324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1077/2138] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:28 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:29.099496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c0e312ac95466bb0bc71cb7e8dd45a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.110123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c0e312ac95466bb0bc71cb7e8dd45a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.111309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c0e312ac95466bb0bc71cb7e8dd45a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.119988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1062/2139] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:28 2021] DELETE /identity/v3/users/28c0e312ac95466bb0bc71cb7e8dd45a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:29.313144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:29.322164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc02332-e399-47db-8036-ae706c91afcc service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:29.381822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:29.382506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:29.382807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:29.383079 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:29.384882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:29.409233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:29.411830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:29.464938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:29.467068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:29.487933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1078/2140] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:29 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:29.496913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392526cb-8a04-4858-b1ac-4add974293cc admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:29.517257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:29.522379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:29.522904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:29.523339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] PATH_INFO: `/v3/projects/71fb819321844be4958772e1861f3d71` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:29.525048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fb819321844be4958772e1861f3d71)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:29.527976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:29.648942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fb819321844be4958772e1861f3d71', 'request_id': 'req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.655047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fb819321844be4958772e1861f3d71', 'request_id': 'req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.695447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:29.696922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:29.727758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212cfa7-1d46-4317-9bc3-7eca07356cbc service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:29.739390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fb819321844be4958772e1861f3d71', 'request_id': 'req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.752293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] The token cache is being invalidate because project 71fb819321844be4958772e1861f3d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:29.752587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.753335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0d2f514a-ea5e-4ba0-b986-62b51416a3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.755310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1063/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:29 2021] DELETE /identity/v3/projects/71fb819321844be4958772e1861f3d71 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:29.793880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:29.794786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:29.795062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:29.795361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] PATH_INFO: `/v3/projects/30891d51702a49aaa6702535124f7109` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:29.796698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30891d51702a49aaa6702535124f7109)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:29.798778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:29.917051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30891d51702a49aaa6702535124f7109', 'request_id': 'req-43c74e66-4420-403f-8df3-9666044c3c52'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:29.927058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30891d51702a49aaa6702535124f7109', 'request_id': 'req-43c74e66-4420-403f-8df3-9666044c3c52'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:30.000475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30891d51702a49aaa6702535124f7109', 'request_id': 'req-43c74e66-4420-403f-8df3-9666044c3c52'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:30.018988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] The token cache is being invalidate because project 30891d51702a49aaa6702535124f7109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:30.019406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:30.020159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-43c74e66-4420-403f-8df3-9666044c3c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:30.021884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1079/2142] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:29 2021] DELETE /identity/v3/projects/30891d51702a49aaa6702535124f7109 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:30.028940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.029420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.029497 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.050801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:30.052080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:30.118105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1064/2143] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:30.127896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.127896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.128211 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.148050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:30.149414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:30.159741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1080/2144] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:30.163697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:30.175750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135ae963-61f7-403e-9d05-c9418a6d0984 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:30.184202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:30.195043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.195340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.195618 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.196870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:30.197046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:30.199020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:30.213488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1065/2145] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:17:30.217674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:30.228982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbeb6b-d557-4e38-86a3-f5d3f1523ef6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:30.235745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:30.236602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.236888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.242723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.244500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:30.248383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:30.361666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1081/2146] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:30 2021] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:17:30.362870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:30.373418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c070b3-2a5d-4558-9355-f447d3f25f61 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:30.436822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:30.438464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.438927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.439368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.440327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:30.442838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:30.729420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1066/2147] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:30 2021] POST /identity/v3/users => generated 287 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:30.736214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:30.747937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b04ff-89fd-4a47-b53d-ca61713b1f48 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:30.753425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:30.754265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.754677 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.755050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.755870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:30.757523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:30.772623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1082/2148] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:30 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:30.777418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:30.793978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c661a3b7-ca65-4642-95f1-8806ff97bdb6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:30.798412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0520c-508a-44f1-8870-c4fa631b1c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:30.799531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0520c-508a-44f1-8870-c4fa631b1c59 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.799531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0520c-508a-44f1-8870-c4fa631b1c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.799748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0520c-508a-44f1-8870-c4fa631b1c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.800431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0520c-508a-44f1-8870-c4fa631b1c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:30.803229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0520c-508a-44f1-8870-c4fa631b1c59 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:30.815541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1067/2149] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:30 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:30.820427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:30.832493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc5a1e-8ae5-425d-91c2-430d0326babe admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:30.838175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:30.839470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.839756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.840033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] PATH_INFO: `/v3/projects/2ccf4a61cc694f948205f646df3c3622/users/0fd32fe141a547368b7c16df3156aa16/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.856985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ccf4a61cc694f948205f646df3c3622, user_id=0fd32fe141a547368b7c16df3156aa16, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:30.858871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:30.948678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1083/2150] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:30 2021] PUT /identity/v3/projects/2ccf4a61cc694f948205f646df3c3622/users/0fd32fe141a547368b7c16df3156aa16/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:30.961147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e0a20-cd87-48a3-b43e-bd532c169803 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:30.961435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e0a20-cd87-48a3-b43e-bd532c169803 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:30.961710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e0a20-cd87-48a3-b43e-bd532c169803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:30.987846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-931e0a20-cd87-48a3-b43e-bd532c169803 None None] MFA Rules not processed for user `0fd32fe141a547368b7c16df3156aa16`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:30.989067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-931e0a20-cd87-48a3-b43e-bd532c169803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:31.064481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1068/2151] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:30 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:31.072371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:31.073783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:31.154223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e076b9c-2ce6-4fb4-9fef-74859fa9a52d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:31.158994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:31.159731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:31.160092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:31.160974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:31.169629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:31.171629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:31.183662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1084/2152] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:31 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:33.068488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c1a7-ecf9-40d7-b62f-642569a3ee11 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:33.069029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c1a7-ecf9-40d7-b62f-642569a3ee11 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:33.069029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962c1a7-ecf9-40d7-b62f-642569a3ee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:33.086339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9962c1a7-ecf9-40d7-b62f-642569a3ee11 None None] MFA Rules not processed for user `0fd32fe141a547368b7c16df3156aa16`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:33.087743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9962c1a7-ecf9-40d7-b62f-642569a3ee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:33.097265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1069/2153] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:33 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:34.683528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:34.684910 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:34.764878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76281ba3-9363-4b20-89a0-255c73ef4c5c service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:34.769615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:34.770486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:34.770800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:34.771189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] PATH_INFO: `/v3/users/40544e66e21f47cb9bde4dd8320059fd` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:34.773398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=40544e66e21f47cb9bde4dd8320059fd)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:34.775633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:35.021218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40544e66e21f47cb9bde4dd8320059fd'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:35.035965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40544e66e21f47cb9bde4dd8320059fd'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:35.043345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40544e66e21f47cb9bde4dd8320059fd'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:35.114082 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40544e66e21f47cb9bde4dd8320059fd'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:35.115065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40544e66e21f47cb9bde4dd8320059fd'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:35.122023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1085/2154] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:34 2021] DELETE /identity/v3/users/40544e66e21f47cb9bde4dd8320059fd => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:35.126548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:35.127054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:35.127154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:35.146958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:35.148462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:35.208679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1070/2155] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:35.218384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:35.220391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:35.277375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f034d7a-cfd3-43f1-88a0-a39ffe7c65bf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:35.281069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:35.281713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:35.281991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:35.282263 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:35.291546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:35.293690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:35.302381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1086/2156] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:35.740273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:35.741737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:35.754166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc8bd3-b1ce-4e0a-be31-5887bf3179bc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:35.759490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:35.760677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:35.760850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:35.761182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] PATH_INFO: `/v3/projects/fef37d0d6c6748308919bbed9fee3979` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:35.762452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef37d0d6c6748308919bbed9fee3979)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:35.764858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:35.870269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef37d0d6c6748308919bbed9fee3979', 'request_id': 'req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:35.876452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef37d0d6c6748308919bbed9fee3979', 'request_id': 'req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.005646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef37d0d6c6748308919bbed9fee3979', 'request_id': 'req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.019673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] The token cache is being invalidate because project fef37d0d6c6748308919bbed9fee3979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:36.024012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.024012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.026429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1071/2157] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:35 2021] DELETE /identity/v3/projects/fef37d0d6c6748308919bbed9fee3979 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:36.027412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:36.037752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f67961-4d21-4f42-a8a9-66e4da36e1c0 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:36.101038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:36.103188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:36.107259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:36.107259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] PATH_INFO: `/v3/users/a96adbcd7fff4ab5a9ec733220973a24` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:36.107259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a96adbcd7fff4ab5a9ec733220973a24)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:36.107259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:36.386607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a96adbcd7fff4ab5a9ec733220973a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.398496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a96adbcd7fff4ab5a9ec733220973a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.406336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a96adbcd7fff4ab5a9ec733220973a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.505323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a96adbcd7fff4ab5a9ec733220973a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.505896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cbbccbff-4a4e-4ecb-a7e8-5bc57216f120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a96adbcd7fff4ab5a9ec733220973a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:36.516590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1087/2158] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:36 2021] DELETE /identity/v3/users/a96adbcd7fff4ab5a9ec733220973a24 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:17:37.088650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:37.093012 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:37.128637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2102aec-0ad4-403c-bb9e-87e2ead03f7d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:37.276702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:37.277358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:37.277641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:37.277912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] PATH_INFO: `/v3/projects/35a7e1a54bd1423c81ddfe0695749650` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:37.279661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a7e1a54bd1423c81ddfe0695749650)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:37.282074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:37.465665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a7e1a54bd1423c81ddfe0695749650', 'request_id': 'req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:37.474958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a7e1a54bd1423c81ddfe0695749650', 'request_id': 'req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:37.545260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a7e1a54bd1423c81ddfe0695749650', 'request_id': 'req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:37.557528 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] The token cache is being invalidate because project 35a7e1a54bd1423c81ddfe0695749650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:37.557824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:37.558467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-325f4d7a-0bcb-42e7-a70f-2ae7bf7faa25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:37.560035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1072/2159] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:37 2021] DELETE /identity/v3/projects/35a7e1a54bd1423c81ddfe0695749650 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:37.565857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:37.566385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:37.566502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:37.586268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:37.587580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:37.648845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1088/2160] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:37.658005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:37.658005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:37.658277 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:37.677118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:37.678376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:37.688203 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1073/2161] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:37.692458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:37.702064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6839f7-b9b8-439b-9771-578f4fee480a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:37.706757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:37.707428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:37.707710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:37.707989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:37.708755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:37.709054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:37.710759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:37.723289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1089/2162] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:17:37.727679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:37.737752 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e26f-02f9-48cf-bf9a-c7d6fa1f1f10 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:37.743013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:37.743737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:37.744028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:37.744315 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:37.744998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:37.746970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:37.852707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1074/2163] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:37 2021] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:37.853899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:37.866073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfba697-f4bc-427b-ac32-9a94291a648a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:37.939457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:37.940136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:37.940415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:37.940688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:37.941569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:37.943538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:38.035984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1090/2164] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:37 2021] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:38.040166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:38.051146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb8a43-1db4-421b-b5d1-af7bc67e560f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:38.058764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:38.059424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:38.059704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:38.059977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:38.060701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:38.062282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:38.073142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1075/2165] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:38.077732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:38.088688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ed123-b4da-40b5-aaa6-24f7f83e89a3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:38.093407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0013b-d55b-4fe8-95ab-c419792f7b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:38.096332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0013b-d55b-4fe8-95ab-c419792f7b4c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:38.096332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0013b-d55b-4fe8-95ab-c419792f7b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:38.096332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0013b-d55b-4fe8-95ab-c419792f7b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:38.096689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0013b-d55b-4fe8-95ab-c419792f7b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:38.098654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0013b-d55b-4fe8-95ab-c419792f7b4c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:38.110882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1091/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:38.114670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:38.130631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aafe4e-f3df-4e19-9e3c-6f441edc4878 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:38.130631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:38.131037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:38.131443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:38.131725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] PATH_INFO: `/v3/projects/6412cbff9d604ea1b11a7f5a1cff41ec/users/2bd2f79f3f474b6b9ec53a2685ae3568/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:38.147192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6412cbff9d604ea1b11a7f5a1cff41ec, user_id=2bd2f79f3f474b6b9ec53a2685ae3568, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:38.150611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:38.292070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1076/2167] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:38 2021] PUT /identity/v3/projects/6412cbff9d604ea1b11a7f5a1cff41ec/users/2bd2f79f3f474b6b9ec53a2685ae3568/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:38.302723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:38.303098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:38.303447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:38.345374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] MFA Rules not processed for user `2bd2f79f3f474b6b9ec53a2685ae3568`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:38.345374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:38.410149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1092/2168] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:38 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:38.426702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:38.428367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:38.512286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70d562-ee6b-4957-af87-bf23fa661ce8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:38.512286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c498b1e4-8277-4c17-bed8-719c31cb42b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:38.512286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b1e4-8277-4c17-bed8-719c31cb42b2 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:38.512286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b1e4-8277-4c17-bed8-719c31cb42b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:38.512693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c498b1e4-8277-4c17-bed8-719c31cb42b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:38.521016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498b1e4-8277-4c17-bed8-719c31cb42b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:38.521016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c498b1e4-8277-4c17-bed8-719c31cb42b2 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:38.539726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1077/2169] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:38 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:49.041560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:49.106102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ee17f-424b-413b-8584-db6b644ce6f7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:49.112658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:49.113539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:49.113826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:49.114107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] PATH_INFO: `/v3/users/2bd2f79f3f474b6b9ec53a2685ae3568` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:49.115328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd2f79f3f474b6b9ec53a2685ae3568)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:49.117554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:49.297709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd2f79f3f474b6b9ec53a2685ae3568'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:49.310174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd2f79f3f474b6b9ec53a2685ae3568'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:49.317619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd2f79f3f474b6b9ec53a2685ae3568'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:49.416972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd2f79f3f474b6b9ec53a2685ae3568'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:49.417590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd2f79f3f474b6b9ec53a2685ae3568'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:49.424674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1093/2170] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:49 2021] DELETE /identity/v3/users/2bd2f79f3f474b6b9ec53a2685ae3568 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:49.429264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:49.429715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:49.429818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:49.447157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:49.448342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:49.507903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1078/2171] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:49.523960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:49.523960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:49.582092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42cc2d-bc09-4103-9229-84f965827c1c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:49.585853 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d12f4b-024a-45a4-a28e-1add4ac9a9a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:49.586495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d12f4b-024a-45a4-a28e-1add4ac9a9a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:49.586822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d12f4b-024a-45a4-a28e-1add4ac9a9a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:49.587080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d12f4b-024a-45a4-a28e-1add4ac9a9a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:49.596354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d12f4b-024a-45a4-a28e-1add4ac9a9a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:49.597811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d12f4b-024a-45a4-a28e-1add4ac9a9a3 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:49.607050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1094/2172] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:50.133282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.134745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:50.146555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f01e92-658b-457b-8f3d-ba8c4bcd6df2 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.151326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.152186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.152470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.152825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] PATH_INFO: `/v3/projects/6412cbff9d604ea1b11a7f5a1cff41ec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.154015 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6412cbff9d604ea1b11a7f5a1cff41ec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.155957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:50.278668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6412cbff9d604ea1b11a7f5a1cff41ec', 'request_id': 'req-10b09d33-614d-4a1d-be49-c16074b9dc3e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:50.285328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6412cbff9d604ea1b11a7f5a1cff41ec', 'request_id': 'req-10b09d33-614d-4a1d-be49-c16074b9dc3e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:50.394415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6412cbff9d604ea1b11a7f5a1cff41ec', 'request_id': 'req-10b09d33-614d-4a1d-be49-c16074b9dc3e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:50.405452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] The token cache is being invalidate because project 6412cbff9d604ea1b11a7f5a1cff41ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:50.405741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:50.406370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-10b09d33-614d-4a1d-be49-c16074b9dc3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:50.408612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1079/2173] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:50 2021] DELETE /identity/v3/projects/6412cbff9d604ea1b11a7f5a1cff41ec => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:50.414877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.415358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.415449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.436205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:50.437555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:50.496364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1095/2174] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:50.503915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.504408 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.504528 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.522424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:50.523659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:50.533906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1080/2175] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:50.538489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.548162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043eb95-6ae6-4f05-84f1-f7b53f866061 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.553453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.554163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.555245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.555245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.555544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:50.555851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.557460 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:50.568663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1096/2176] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:17:50.573120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.582732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fccf4b-7628-43e1-ad13-4f24ba9780f4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.587338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.588068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.588347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.589639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.589639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.591275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:50.695980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1081/2177] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:50 2021] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:50.700033 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.710238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43295d-4cc9-439d-9fea-6d306cc75851 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.763664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.764318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.764600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.764874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.765557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.768165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:50.839644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1097/2178] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:50 2021] POST /identity/v3/users => generated 280 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:50.843661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.854373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407d597-079d-4696-96f0-1ea9d7011a3b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.859103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.859763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.860047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.860322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.861049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.862675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:50.876216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1082/2179] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:50.877429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.887484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48009ec-602a-448d-992b-1088d4382f14 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.892690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4192ad-0bb8-47f8-a3c6-3478f2795e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.893355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4192ad-0bb8-47f8-a3c6-3478f2795e14 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.893646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4192ad-0bb8-47f8-a3c6-3478f2795e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.893924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4192ad-0bb8-47f8-a3c6-3478f2795e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.894706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4192ad-0bb8-47f8-a3c6-3478f2795e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.896306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4192ad-0bb8-47f8-a3c6-3478f2795e14 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:50.909955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1098/2180] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:50.911131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:50.921065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a2b92-dba4-4cb0-9ee9-4b1c60f147f3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:50.925763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:50.926740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:50.927024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:50.927299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] PATH_INFO: `/v3/projects/14d84e1e42b64f6081d4e896e0990236/users/4b77327a14af4c0391ee9a9b355a085e/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:50.942257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d84e1e42b64f6081d4e896e0990236, user_id=4b77327a14af4c0391ee9a9b355a085e, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:50.944955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:51.054395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1083/2181] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:50 2021] PUT /identity/v3/projects/14d84e1e42b64f6081d4e896e0990236/users/4b77327a14af4c0391ee9a9b355a085e/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:51.065885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:51.066183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:51.066461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:51.093945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] MFA Rules not processed for user `4b77327a14af4c0391ee9a9b355a085e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:51.095180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:51.157406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1099/2182] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:51 2021] POST /identity/v3/auth/tokens => generated 3379 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:51.196930 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:51.199077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:51.253955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2e988-09c0-46ea-8bdf-2281decd9493 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:51.257598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081abab2-3532-4ebd-a9b5-c8931ed5822e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:51.258234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abab2-3532-4ebd-a9b5-c8931ed5822e service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:51.258603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abab2-3532-4ebd-a9b5-c8931ed5822e service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:51.258884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081abab2-3532-4ebd-a9b5-c8931ed5822e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:51.266908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081abab2-3532-4ebd-a9b5-c8931ed5822e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:51.268940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081abab2-3532-4ebd-a9b5-c8931ed5822e service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:51.277440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1084/2183] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:51 2021] GET /identity/v3/auth/tokens => generated 3379 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:51.304120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:51.351408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012e616-380f-48f2-8d2d-1d55d6237934 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:51.355974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:51.356834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:51.361548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:51.361548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] PATH_INFO: `/v3/users/4b77327a14af4c0391ee9a9b355a085e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:51.361548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b77327a14af4c0391ee9a9b355a085e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:51.361548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:51.498524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b77327a14af4c0391ee9a9b355a085e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:51.512041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b77327a14af4c0391ee9a9b355a085e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:51.519296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b77327a14af4c0391ee9a9b355a085e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:51.582834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b77327a14af4c0391ee9a9b355a085e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:51.583448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b77327a14af4c0391ee9a9b355a085e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:51.590379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1100/2184] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:17:51 2021] DELETE /identity/v3/users/4b77327a14af4c0391ee9a9b355a085e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:51.594959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:51.596024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:51.596116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:51.616492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:51.616492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:51.674597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1085/2185] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:51.684371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:51.685777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:51.739935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3401bc8-281f-4434-8ccd-ea7bc811484e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:51.743886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfa2e4-3431-40ce-a7e9-8a429825f844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:51.744512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa2e4-3431-40ce-a7e9-8a429825f844 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:51.744790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa2e4-3431-40ce-a7e9-8a429825f844 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:51.745059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfa2e4-3431-40ce-a7e9-8a429825f844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:51.754334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfa2e4-3431-40ce-a7e9-8a429825f844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:51.755791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dfa2e4-3431-40ce-a7e9-8a429825f844 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:51.765071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1101/2186] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:17:52.222436 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:52.226857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:52.237599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831580c5-15cd-41ea-a90f-c4b440253cf7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:52.243363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:52.245089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.245193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.245412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] PATH_INFO: `/v3/projects/14d84e1e42b64f6081d4e896e0990236` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.246976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d84e1e42b64f6081d4e896e0990236)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:52.248885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:52.362246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d84e1e42b64f6081d4e896e0990236', 'request_id': 'req-fa21697e-69e2-4ac8-ade7-595e6b907e3d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:52.368628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d84e1e42b64f6081d4e896e0990236', 'request_id': 'req-fa21697e-69e2-4ac8-ade7-595e6b907e3d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:52.428463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d84e1e42b64f6081d4e896e0990236', 'request_id': 'req-fa21697e-69e2-4ac8-ade7-595e6b907e3d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:52.438558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] The token cache is being invalidate because project 14d84e1e42b64f6081d4e896e0990236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:17:52.438916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:52.440133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fa21697e-69e2-4ac8-ade7-595e6b907e3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:17:52.441624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1086/2187] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:17:52 2021] DELETE /identity/v3/projects/14d84e1e42b64f6081d4e896e0990236 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:52.447271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.447564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.447850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.465783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:52.467011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:52.523193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1102/2188] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:52.531124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.531366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.531646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.556586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:52.557791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:52.568454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1087/2189] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:17:52.571497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:52.581869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077bc51-3519-48a1-9627-0a5b99bcf61b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:52.586546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:52.587228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.587514 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.587924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.588654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:17:52.588963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:52.590618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:52.602022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1103/2190] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:17:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:17:52.606836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:52.618738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb0133-0a56-483b-b006-b816ad9394d7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:52.623474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:52.624131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.624415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.624694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.625394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:52.627877 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:52.761414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1088/2191] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:17:52 2021] POST /identity/v3/projects => generated 389 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:52.765640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:52.776326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff4bfe-8ed0-478c-abea-5699cba76797 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:52.835648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:52.836640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.837064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.837473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.838535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:52.841836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:52.943223 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1104/2192] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:17:52 2021] POST /identity/v3/users => generated 295 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:17:52.947368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:52.957927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02779ec0-029f-42ce-af68-5caa1e7ce443 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:52.962774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:52.963429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.963709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.963981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.964694 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:52.966268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:52.976542 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1089/2193] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:17:52.980227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:52.990615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c374218-d2fc-4fdf-a784-61b905cee3ea admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:52.995468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f02f03-1d06-45f5-b273-ebe302e513e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:52.996121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02f03-1d06-45f5-b273-ebe302e513e8 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:52.996431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02f03-1d06-45f5-b273-ebe302e513e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:52.996705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f02f03-1d06-45f5-b273-ebe302e513e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:52.997423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02f03-1d06-45f5-b273-ebe302e513e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:52.999049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f02f03-1d06-45f5-b273-ebe302e513e8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:53.009330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1105/2194] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:17:52 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:17:53.013463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:53.023643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eecf2-0e26-4abf-9907-e06dad9526de admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:53.028271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:53.029139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:53.029423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:53.029707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] PATH_INFO: `/v3/projects/9113b95c5ea940249f71091f49c7d804/users/3b211224bee64bf5bd5a4e3c44f442f0/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:53.043669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9113b95c5ea940249f71091f49c7d804, user_id=3b211224bee64bf5bd5a4e3c44f442f0, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:53.046248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:53.114346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1090/2195] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:17:53 2021] PUT /identity/v3/projects/9113b95c5ea940249f71091f49c7d804/users/3b211224bee64bf5bd5a4e3c44f442f0/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:17:53.124682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c609f-0e22-4800-ab7e-2ee0d44c4821 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:53.125008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c609f-0e22-4800-ab7e-2ee0d44c4821 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:53.125290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c609f-0e22-4800-ab7e-2ee0d44c4821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:53.151626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4c6c609f-0e22-4800-ab7e-2ee0d44c4821 None None] MFA Rules not processed for user `3b211224bee64bf5bd5a4e3c44f442f0`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:53.152840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4c6c609f-0e22-4800-ab7e-2ee0d44c4821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:53.215351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1106/2196] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:17:53 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:53.225841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:53.227638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:53.286274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa991b5c-125f-4c16-b50e-f8a2031cf084 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:53.290038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:53.290720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:53.290999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:53.291345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:53.305199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:53.305199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:53.311275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1091/2197] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:17:53 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:17:54.372278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b199-0c91-4aa2-b6ff-03c3dbaf1d76 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:54.372741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b199-0c91-4aa2-b6ff-03c3dbaf1d76 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:54.373080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6b199-0c91-4aa2-b6ff-03c3dbaf1d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:54.394212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-55f6b199-0c91-4aa2-b6ff-03c3dbaf1d76 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:17:54.395534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-55f6b199-0c91-4aa2-b6ff-03c3dbaf1d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:54.450060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1107/2198] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:17:54 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:17:54.496313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:17:54.497698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:17:54.585306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa470ae-2d85-447a-a192-aef95f3dcc2c service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:17:54.591034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:17:54.591989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:17:54.592356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:17:54.592781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:17:54.601822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:17:54.603471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:17:54.612876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1092/2199] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:17:54 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:00.612641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6434d-25b0-423c-bdb6-a7b5aeb519e7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:00.613349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6434d-25b0-423c-bdb6-a7b5aeb519e7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:00.613832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe6434d-25b0-423c-bdb6-a7b5aeb519e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:00.647562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ffe6434d-25b0-423c-bdb6-a7b5aeb519e7 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:00.649320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ffe6434d-25b0-423c-bdb6-a7b5aeb519e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:00.678118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1108/2200] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:18:00 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:00.691322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:00.732447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307daef-7e79-4c65-896c-d07875766102 service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:00.738988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:00.739632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:00.739914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:00.740186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:00.748454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:00.750026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:00.758468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1093/2201] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:18:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:02.338862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564868c-cda0-41a6-9119-4816717d155a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:02.339919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564868c-cda0-41a6-9119-4816717d155a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:02.340460 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564868c-cda0-41a6-9119-4816717d155a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:02.360780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8564868c-cda0-41a6-9119-4816717d155a None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:02.362625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8564868c-cda0-41a6-9119-4816717d155a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:02.377574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1109/2202] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:18:02 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:02.390459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:02.407311 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ffcd5-bf4f-428c-873e-3aaf2e41025f service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:02.413310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:02.416388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:02.416388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:02.416388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:02.427033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:02.428928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:02.441225 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1094/2203] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:18:02 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:03.077343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:03.077635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:03.077970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:03.096657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:03.097887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:03.105418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1110/2204] 10.222.0.16 () {58 vars in 968 bytes} [Tue Aug 10 05:18:03 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:03.122129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:03.135563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca060d-f1b9-4053-8094-f35858d7aedd service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:03.140903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a23cde-c3d1-4480-8567-b3abb7869c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:03.141764 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23cde-c3d1-4480-8567-b3abb7869c09 service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:03.142157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23cde-c3d1-4480-8567-b3abb7869c09 service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:03.142512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a23cde-c3d1-4480-8567-b3abb7869c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:03.153484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a23cde-c3d1-4480-8567-b3abb7869c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:03.155566 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a23cde-c3d1-4480-8567-b3abb7869c09 service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:03.164910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1095/2205] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:18:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 05:18:06.049802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:06.051282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:06.143519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d340a-f70b-4787-ab40-4c5541a7cc2c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:06.148054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:06.148921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:06.149204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:06.149477 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] PATH_INFO: `/v3/users/0fd32fe141a547368b7c16df3156aa16` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:06.150777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd32fe141a547368b7c16df3156aa16)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:06.152715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:06.378251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd32fe141a547368b7c16df3156aa16'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:06.395059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd32fe141a547368b7c16df3156aa16'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:06.401775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd32fe141a547368b7c16df3156aa16'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:06.468793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd32fe141a547368b7c16df3156aa16'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:06.469742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd32fe141a547368b7c16df3156aa16'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:06.480750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1111/2206] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:06 2021] DELETE /identity/v3/users/0fd32fe141a547368b7c16df3156aa16 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:06.481889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:06.482664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:06.482664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:06.509572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:06.511237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:06.598496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1096/2207] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:18:06.619956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:06.621909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:06.716914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f0af3-2864-41f9-b342-4a2ba8497e84 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:06.723888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f86dda-205e-4664-b086-817389c96dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:06.725412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86dda-205e-4664-b086-817389c96dff service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:06.726075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86dda-205e-4664-b086-817389c96dff service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:06.726552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f86dda-205e-4664-b086-817389c96dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:06.740869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86dda-205e-4664-b086-817389c96dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:06.742713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f86dda-205e-4664-b086-817389c96dff service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:06.758761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1112/2208] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:07.018992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:07.020646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:07.037899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed7077-b05c-4542-8eab-0dcc4c8773fd None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:07.046308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:07.061359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.061663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.061958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] PATH_INFO: `/v3/projects/2ccf4a61cc694f948205f646df3c3622` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.066469 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ccf4a61cc694f948205f646df3c3622)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:07.068543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:07.209346 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ccf4a61cc694f948205f646df3c3622', 'request_id': 'req-ede247eb-c0a3-4a6b-af67-3f89113a4910'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:07.225652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ccf4a61cc694f948205f646df3c3622', 'request_id': 'req-ede247eb-c0a3-4a6b-af67-3f89113a4910'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:07.352269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ccf4a61cc694f948205f646df3c3622', 'request_id': 'req-ede247eb-c0a3-4a6b-af67-3f89113a4910'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:07.366357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] The token cache is being invalidate because project 2ccf4a61cc694f948205f646df3c3622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:07.366985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:07.367685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ede247eb-c0a3-4a6b-af67-3f89113a4910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:07.369297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1097/2209] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:07 2021] DELETE /identity/v3/projects/2ccf4a61cc694f948205f646df3c3622 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:07.375655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.377374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.377824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.451761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:07.453076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:07.579140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1113/2210] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:07.587928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.588632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.588632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.614388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:07.615651 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:07.623696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1098/2211] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:18:07.628091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:07.637903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9eef9-43a8-48dc-be8e-ae6822fb9bd8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:07.642527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:07.645515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.645515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.645515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.645515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:18:07.645515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:07.646350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:07.658489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1114/2212] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:18:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:18:07.662568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:07.671910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd94f96-f585-4921-aa4c-18d4b116c5a4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:07.677738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:07.678244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.678736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.679384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.680136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:07.682184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:07.763458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1099/2213] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:07 2021] POST /identity/v3/projects => generated 399 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:18:07.770745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:07.781122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e2b47-8aed-4c93-8033-4ad3fdce9fae admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:07.863339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:07.864058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.864345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.864624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.865470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:07.867708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:07.963217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1115/2214] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:07 2021] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:07.967288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:07.978212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083ed1c-f786-423a-a2f1-ba91f51873a8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:07.983017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:07.983623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:07.983904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:07.984178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:07.984898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:07.986483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:07.997037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1100/2215] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:08.000977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:08.010698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ca287-4749-4f72-ae29-fabdd1cccdd0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:08.015312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b6bbf-e2e4-4d1e-83f9-bfd0dad2f7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:08.015957 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6bbf-e2e4-4d1e-83f9-bfd0dad2f7fc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:08.016237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6bbf-e2e4-4d1e-83f9-bfd0dad2f7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:08.016513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b6bbf-e2e4-4d1e-83f9-bfd0dad2f7fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:08.017738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6bbf-e2e4-4d1e-83f9-bfd0dad2f7fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:08.019356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b6bbf-e2e4-4d1e-83f9-bfd0dad2f7fc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:08.028799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1116/2216] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:08 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:08.032698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:08.042950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51793d0c-6a98-4d38-813d-7f288155b48f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:08.047432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:08.048351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:08.048659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:08.048938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] PATH_INFO: `/v3/projects/9e31917bed334bc990b991d39454e348/users/db1412da45fe40b7aa9afdeebdd1fd2a/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:08.063221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e31917bed334bc990b991d39454e348, user_id=db1412da45fe40b7aa9afdeebdd1fd2a, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:08.065839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:08.137585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1101/2217] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:08 2021] PUT /identity/v3/projects/9e31917bed334bc990b991d39454e348/users/db1412da45fe40b7aa9afdeebdd1fd2a/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:08.148462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281177-82fc-4a1f-b6c9-5a8f4dc8816d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:08.148780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281177-82fc-4a1f-b6c9-5a8f4dc8816d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:08.149060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25281177-82fc-4a1f-b6c9-5a8f4dc8816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:08.177350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-25281177-82fc-4a1f-b6c9-5a8f4dc8816d None None] MFA Rules not processed for user `db1412da45fe40b7aa9afdeebdd1fd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:08.178547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-25281177-82fc-4a1f-b6c9-5a8f4dc8816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:08.239185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1117/2218] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:08 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:08.249891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:08.252122 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:08.307750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038481cf-5841-4f8f-a7f3-662d46843fa2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:08.311446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:08.312092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:08.312375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:08.312644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:08.321664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:08.323131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:08.333125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1102/2219] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:08 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:15.434919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:15.435475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:15.435475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:15.456907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:15.458140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:15.530198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1118/2220] 10.222.0.16 () {58 vars in 968 bytes} [Tue Aug 10 05:18:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:15.542777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:15.544227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:15.613823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e3c7a5-63c5-431f-83c8-7b039a0f48ee service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:15.619389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:15.620067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:15.620366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:15.620643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:15.629602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:15.631329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:15.639535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1103/2221] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:18:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:17.780190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:17.851072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0ff8-7cc3-4848-ae9b-02dd1680b41c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:17.856525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:17.857481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:17.857827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:17.858104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] PATH_INFO: `/v3/users/db1412da45fe40b7aa9afdeebdd1fd2a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:17.859341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1412da45fe40b7aa9afdeebdd1fd2a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:17.861327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:18.022373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:18.023830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.038180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0a768-766e-417f-8664-f946ffd96d30 service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:18.042936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:18.043841 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.044124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.044402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] PATH_INFO: `/v3/users/3b211224bee64bf5bd5a4e3c44f442f0` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.045596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b211224bee64bf5bd5a4e3c44f442f0)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:18.047686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:18.076293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1412da45fe40b7aa9afdeebdd1fd2a'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.095007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1412da45fe40b7aa9afdeebdd1fd2a'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.104019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1412da45fe40b7aa9afdeebdd1fd2a'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.186620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1412da45fe40b7aa9afdeebdd1fd2a'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.187369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d6eff09f-8636-4df8-ad3b-711585895831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1412da45fe40b7aa9afdeebdd1fd2a'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.199620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1119/2222] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:17 2021] DELETE /identity/v3/users/db1412da45fe40b7aa9afdeebdd1fd2a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:18.201323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c9b98-d662-4d50-b135-66c89c788ee1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.201790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c9b98-d662-4d50-b135-66c89c788ee1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.202281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c9b98-d662-4d50-b135-66c89c788ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.220852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-155c9b98-d662-4d50-b135-66c89c788ee1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:18.222803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-155c9b98-d662-4d50-b135-66c89c788ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.238612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b211224bee64bf5bd5a4e3c44f442f0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.255823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b211224bee64bf5bd5a4e3c44f442f0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.295827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1120/2223] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:18.304645 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b723-d375-4631-93be-3c4e006d1a42 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.306720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b723-d375-4631-93be-3c4e006d1a42 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.307226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253b723-d375-4631-93be-3c4e006d1a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.327018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b211224bee64bf5bd5a4e3c44f442f0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.335019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b211224bee64bf5bd5a4e3c44f442f0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.335709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b211224bee64bf5bd5a4e3c44f442f0'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:18.344505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1104/2224] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:18 2021] DELETE /identity/v3/users/3b211224bee64bf5bd5a4e3c44f442f0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:18.345519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:18.348478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.348790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2253b723-d375-4631-93be-3c4e006d1a42 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:18.350732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2253b723-d375-4631-93be-3c4e006d1a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.428020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1121/2225] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:18:18 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:18.429435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.429814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.430171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.436803 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e3fee-5e81-4f7f-b73c-db40468ec9aa admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:18.446297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:18.448087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.448485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.448817 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.451129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.457925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:18.459147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.517123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:18.518626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:18.531781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1105/2226] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:18.532815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:18.535127 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.537535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1122/2227] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:18.557665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:18.559536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:18.573248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3031673-0296-4f10-911a-1a7ee76fc0c1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:18.577381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:18.578174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.578464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.578782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.589722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:18.593619 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:18.601190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1123/2228] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:18:18.623173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e3a59-ec69-4aa2-af41-0281aa5999d6 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:18.624359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:18.627246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:18.627913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:18.628932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:18.640486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:18.642118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:18.651573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1106/2229] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:18:18 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:18:19.242434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:19.244890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:19.263318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b9377-7fe5-4e02-80dc-0d6721a164a9 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:19.270056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:19.271266 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:19.271725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:19.272828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] PATH_INFO: `/v3/users/4c80843a900943ecb7d312088d9bf04b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:19.274462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c80843a900943ecb7d312088d9bf04b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:19.277865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:19.318053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:19.320377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:19.351031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876a89c-ef77-4ed6-a916-661d440a534c service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:19.357474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:19.358603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:19.359095 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:19.359486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] PATH_INFO: `/v3/projects/9e31917bed334bc990b991d39454e348` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:19.361583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e31917bed334bc990b991d39454e348)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:19.363849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:19.571280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e31917bed334bc990b991d39454e348', 'request_id': 'req-31bc7d03-24b7-46cf-be0c-b51d56795270'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.571938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c80843a900943ecb7d312088d9bf04b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.587144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e31917bed334bc990b991d39454e348', 'request_id': 'req-31bc7d03-24b7-46cf-be0c-b51d56795270'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.601916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c80843a900943ecb7d312088d9bf04b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.608883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c80843a900943ecb7d312088d9bf04b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.668972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e31917bed334bc990b991d39454e348', 'request_id': 'req-31bc7d03-24b7-46cf-be0c-b51d56795270'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.685844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] The token cache is being invalidate because project 9e31917bed334bc990b991d39454e348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:19.688924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.688924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.689990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1107/2230] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:19 2021] DELETE /identity/v3/projects/9e31917bed334bc990b991d39454e348 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:19.691583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:19.692685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:19.750494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c80843a900943ecb7d312088d9bf04b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.751482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-45eb0b58-8a8d-4c3b-895b-badbe75b2a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c80843a900943ecb7d312088d9bf04b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:19.759302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1124/2231] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:19 2021] DELETE /identity/v3/users/4c80843a900943ecb7d312088d9bf04b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:19.760670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47a59-815c-4795-a6d3-03c8930d432b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:19.761085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47a59-815c-4795-a6d3-03c8930d432b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:19.761369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47a59-815c-4795-a6d3-03c8930d432b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:19.807420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3fa47a59-815c-4795-a6d3-03c8930d432b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:19.808865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3fa47a59-815c-4795-a6d3-03c8930d432b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:19.823153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7d03-24b7-46cf-be0c-b51d56795270 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:19.915512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:19.916510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:19.916830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1125/2232] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:19.917216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:19.917576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] PATH_INFO: `/v3/projects/9113b95c5ea940249f71091f49c7d804` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:19.919475 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9113b95c5ea940249f71091f49c7d804)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:19.921829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:19.925717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:19.926012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:19.926350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:19.947967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:19.951414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:19.961649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1126/2233] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:19.966284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:19.976425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1461fd3-dee6-4b0a-9681-afb79023d671 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:19.981507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:19.982428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:19.982553 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:19.982931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:19.983644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:18:19.983931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:19.985874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.000142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1127/2234] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:18:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:18:20.005227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.016462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afcd3f-99ef-4d1e-9d35-17142c660987 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.025324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.030805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.030805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.030805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.030805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.030805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.076291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9113b95c5ea940249f71091f49c7d804', 'request_id': 'req-6fa73490-aebe-4d5a-a790-c5b0c60d4169'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.083629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9113b95c5ea940249f71091f49c7d804', 'request_id': 'req-6fa73490-aebe-4d5a-a790-c5b0c60d4169'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.143502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1128/2235] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:20 2021] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:20.145019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.146912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:20.158385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9113b95c5ea940249f71091f49c7d804', 'request_id': 'req-6fa73490-aebe-4d5a-a790-c5b0c60d4169'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.174253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] The token cache is being invalidate because project 9113b95c5ea940249f71091f49c7d804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:20.174557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.175294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.193259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1108/2236] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:19 2021] DELETE /identity/v3/projects/9113b95c5ea940249f71091f49c7d804 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:20.193259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.193259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:20.257037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb7f1b-6253-4c24-8d58-6996e23bd29d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.265179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.267501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.268021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.268524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] PATH_INFO: `/v3/projects/2d4061dd7eb245a69b1eff088985076c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.272767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4061dd7eb245a69b1eff088985076c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.276602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.312584 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa73490-aebe-4d5a-a790-c5b0c60d4169 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.335133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.335133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.335133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.335133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.336026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.336026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.454262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4061dd7eb245a69b1eff088985076c', 'request_id': 'req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.464184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4061dd7eb245a69b1eff088985076c', 'request_id': 'req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.464448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1109/2237] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:20 2021] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:20.469226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.483306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf21a5-f272-4b37-9365-49595982bef6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.547240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.547925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.548197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.548468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.550630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.558307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.563852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1110/2238] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:20.571427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.578706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4061dd7eb245a69b1eff088985076c', 'request_id': 'req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.587838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db15ef9-06a4-4274-b1b0-78b20817c001 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.593780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.595483 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.595590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] The token cache is being invalidate because project 2d4061dd7eb245a69b1eff088985076c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:20.595590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.595769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.595769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.596299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.597268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a5b74c3e-30eb-4ba0-8cd1-52b72b9d2091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:20.598227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.600107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1129/2239] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:20 2021] DELETE /identity/v3/projects/2d4061dd7eb245a69b1eff088985076c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:20.605844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768267-f18f-441b-ace3-46ab17d4a4b4 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.606209 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768267-f18f-441b-ace3-46ab17d4a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.606742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc768267-f18f-441b-ace3-46ab17d4a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.618919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1111/2240] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:20 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:20.620054 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.624621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:20.639407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092a562-1f18-4030-a733-e67ab2a3f565 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.644548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-cc768267-f18f-441b-ace3-46ab17d4a4b4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:20.646356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cc768267-f18f-441b-ace3-46ab17d4a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:20.647939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513c7a5-94c8-4165-b13d-e10624e99d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.649029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513c7a5-94c8-4165-b13d-e10624e99d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.649518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513c7a5-94c8-4165-b13d-e10624e99d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.649891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513c7a5-94c8-4165-b13d-e10624e99d51 admin admin] PATH_INFO: `/v3/projects/0b0757c9f3474f1d8d45d02c87abef53/users/3378945fb3734bb395995268af72960d/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.664859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1130/2241] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:20.675359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.676245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.677060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.678011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513c7a5-94c8-4165-b13d-e10624e99d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b0757c9f3474f1d8d45d02c87abef53, user_id=3378945fb3734bb395995268af72960d, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.682406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513c7a5-94c8-4165-b13d-e10624e99d51 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.718959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:20.720455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:20.738726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1131/2242] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:20.745406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.755690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f24768-6434-4f6e-976b-0cd268adfc83 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.770194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.773856 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1112/2243] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:20 2021] PUT /identity/v3/projects/0b0757c9f3474f1d8d45d02c87abef53/users/3378945fb3734bb395995268af72960d/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:20.776727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.776727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.776727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.776727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:18:20.776727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.777429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.777429 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.780192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.780963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.807970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:20.809525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:20.814618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1132/2244] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:18:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:18:20.816568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.827855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd3613-ffcc-4c7a-8db6-047e373579c3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:20.922565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1113/2245] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:20.923564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:20.924332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:20.924511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:20.924791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:20.932834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:20.933588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:20.934829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:20.935625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:21.002187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad8cb9-f0b8-48db-807e-415b1cbcfa5f None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:21.006134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:21.006824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.010832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.010832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.017861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:21.019878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:21.030906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1114/2246] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:21.064452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1133/2247] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:20 2021] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:18:21.065964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:21.076360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba6792b-6de2-4b0b-920e-a6c24150ae0c service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:21.156519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:21.157368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.168123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.168123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.168123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:21.168123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:21.318882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1115/2248] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:21 2021] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:21.323413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:21.335959 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e81ad-fd93-4a4a-9850-0697cb455165 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:21.341283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:21.342002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.342297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.342615 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.343407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:21.345081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:21.356997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1134/2249] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:21 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:18:21.360673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:21.379722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba018a-d113-48a8-b4ea-e871c2982ca3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:21.387648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271f858-de82-42b5-937e-575847c56ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:21.388424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271f858-de82-42b5-937e-575847c56ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.388800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271f858-de82-42b5-937e-575847c56ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.389149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271f858-de82-42b5-937e-575847c56ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.389965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271f858-de82-42b5-937e-575847c56ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:21.391837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271f858-de82-42b5-937e-575847c56ed1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:21.413755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1116/2250] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:21 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:21.414434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:21.438368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573272f2-797e-41e6-aa15-832527a862de admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:21.452225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:21.457107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.457365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.457653 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] PATH_INFO: `/v3/projects/9dc3d5d89cee410baeeb0f5b370e9128/users/f9f2e8b728ab4a94804c147c1334c62b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.477825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc3d5d89cee410baeeb0f5b370e9128, user_id=f9f2e8b728ab4a94804c147c1334c62b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:21.482367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:21.582435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1135/2251] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:21 2021] PUT /identity/v3/projects/9dc3d5d89cee410baeeb0f5b370e9128/users/f9f2e8b728ab4a94804c147c1334c62b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:21.592610 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6194-2bf0-418b-b251-3dee4ac98e60 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.592903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6194-2bf0-418b-b251-3dee4ac98e60 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.593181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4def6194-2bf0-418b-b251-3dee4ac98e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.634314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4def6194-2bf0-418b-b251-3dee4ac98e60 None None] MFA Rules not processed for user `f9f2e8b728ab4a94804c147c1334c62b`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:21.636550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4def6194-2bf0-418b-b251-3dee4ac98e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:21.737923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1117/2252] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:21 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:21.754969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:21.756717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:21.836979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b372ef-aaad-4e31-abb8-d29ee92142bc admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:21.841270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:21.841993 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:21.842280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:21.842560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:21.852805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:21.854271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:21.865387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1136/2253] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:21 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:18:31.419665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:31.421307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:31.421307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:31.452608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] MFA Rules not processed for user `3378945fb3734bb395995268af72960d`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:31.453924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:31.522532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1118/2254] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:31 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:31.530112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:31.617997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0754e-03ab-4cb8-baa6-79ff29869029 service glance] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:31.628647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:31.629902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:31.630199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:31.630476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:31.631229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:31.633278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:31.767976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1137/2255] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:31 2021] POST /identity/v3/projects => generated 371 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:18:31.768663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:31.783034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93618d8-4fd8-4d2c-8d05-784c8eb9e967 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:31.904661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:31.905488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:31.906180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:31.906926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:31.908318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:31.911719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:31.996780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1119/2256] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:31 2021] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:32.000860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:32.020897 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816dd4e-1ea5-4a36-bd4b-06391e439629 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:32.026499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:32.027462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:32.027815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:32.028305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:32.029136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:32.030879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:32.044406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1138/2257] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:31 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:32.048596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:32.061801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d47f9-0986-451e-9032-c6eeff3fb73a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:32.066665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:32.068539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:32.068865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:32.069372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] PATH_INFO: `/v3/projects/97411a9801ba4537b5f8c5607c920a7d/users/ed66063e031446a6ba20af7d88585b6d/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:32.099320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97411a9801ba4537b5f8c5607c920a7d, user_id=ed66063e031446a6ba20af7d88585b6d, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:32.102735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:32.178067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1120/2258] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:32 2021] PUT /identity/v3/projects/97411a9801ba4537b5f8c5607c920a7d/users/ed66063e031446a6ba20af7d88585b6d/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:32.182320 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:32.194770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d261f2-5b00-4d12-8286-0f07b06a2a8c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:32.291269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dae152-60f6-49bf-b0eb-88bb51559485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:32.292027 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dae152-60f6-49bf-b0eb-88bb51559485 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:32.292315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dae152-60f6-49bf-b0eb-88bb51559485 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:32.292598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dae152-60f6-49bf-b0eb-88bb51559485 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:32.293334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dae152-60f6-49bf-b0eb-88bb51559485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:32.298158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dae152-60f6-49bf-b0eb-88bb51559485 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:32.312034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1139/2259] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:32 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:32.313222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:32.326480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bbd59-22a5-494c-a78d-3837b00095b5 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:32.334078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:32.335247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:32.335538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:32.336274 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] PATH_INFO: `/v3/projects/97411a9801ba4537b5f8c5607c920a7d/users/ed66063e031446a6ba20af7d88585b6d/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:32.339978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] RBAC: Authorizing `identity:create_grant(project_id=97411a9801ba4537b5f8c5607c920a7d, user_id=ed66063e031446a6ba20af7d88585b6d, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:32.342663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:32.358046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1121/2260] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:32 2021] PUT /identity/v3/projects/97411a9801ba4537b5f8c5607c920a7d/users/ed66063e031446a6ba20af7d88585b6d/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:38.784292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b1f5-074d-4cb8-9d3e-7b0731dabf59 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:38.785196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b1f5-074d-4cb8-9d3e-7b0731dabf59 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:38.785699 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b1f5-074d-4cb8-9d3e-7b0731dabf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:38.818979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e9f3b1f5-074d-4cb8-9d3e-7b0731dabf59 None None] MFA Rules not processed for user `ed66063e031446a6ba20af7d88585b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:38.827537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e9f3b1f5-074d-4cb8-9d3e-7b0731dabf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:38.898277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1140/2261] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:38 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:38.909144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:38.911037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:39.012485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78823c0e-3c17-4eb7-b45f-2c73db14651f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:39.018164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08c93d-693f-4546-8634-87d54d1ed15d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:39.018846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c93d-693f-4546-8634-87d54d1ed15d service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.019130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c93d-693f-4546-8634-87d54d1ed15d service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.019405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08c93d-693f-4546-8634-87d54d1ed15d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.078310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c93d-693f-4546-8634-87d54d1ed15d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:39.080011 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08c93d-693f-4546-8634-87d54d1ed15d service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:39.089457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1122/2262] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:38 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:39.344268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136900-e3ba-4737-aac3-fe3d6d8a3f9f None None] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.344642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136900-e3ba-4737-aac3-fe3d6d8a3f9f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.344823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a136900-e3ba-4737-aac3-fe3d6d8a3f9f None None] PATH_INFO: `/` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.347064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1141/2263] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:18:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:18:39.353832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096298f-ce2a-4fa7-a69a-1ef3d71f5ea0 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.354181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096298f-ce2a-4fa7-a69a-1ef3d71f5ea0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.356509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096298f-ce2a-4fa7-a69a-1ef3d71f5ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.400687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9096298f-ce2a-4fa7-a69a-1ef3d71f5ea0 None None] MFA Rules not processed for user `0b340b0c363a4c1ebaf9311b7349a6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:39.402043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9096298f-ce2a-4fa7-a69a-1ef3d71f5ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:39.416655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1123/2264] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:18:39 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:39.424749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136900-e3ba-4737-aac3-fe3d6d8a3f9f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:39.427182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5a136900-e3ba-4737-aac3-fe3d6d8a3f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:39.484594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a136900-e3ba-4737-aac3-fe3d6d8a3f9f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:39.488423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b718ea1d-0c57-42e9-9fca-cd055889043d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:39.489336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ea1d-0c57-42e9-9fca-cd055889043d service glance] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.489648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ea1d-0c57-42e9-9fca-cd055889043d service glance] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.489927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b718ea1d-0c57-42e9-9fca-cd055889043d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.502166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718ea1d-0c57-42e9-9fca-cd055889043d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:39.503741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b718ea1d-0c57-42e9-9fca-cd055889043d service glance] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:39.515056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1142/2265] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:39 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:39.754784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c893114-5c7e-4c30-8c7a-40fe61161dd1 None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.756202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c893114-5c7e-4c30-8c7a-40fe61161dd1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.756202 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c893114-5c7e-4c30-8c7a-40fe61161dd1 None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.757250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1124/2266] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:18:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:18:39.762136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b7f9-cab3-4620-b6e5-f26af97784f6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.762424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b7f9-cab3-4620-b6e5-f26af97784f6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.762823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b7f9-cab3-4620-b6e5-f26af97784f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.780913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-3401b7f9-cab3-4620-b6e5-f26af97784f6 None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:39.782114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3401b7f9-cab3-4620-b6e5-f26af97784f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:39.840123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1143/2267] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:18:39 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:39.860679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c893114-5c7e-4c30-8c7a-40fe61161dd1 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:39.862645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0c893114-5c7e-4c30-8c7a-40fe61161dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:39.877147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c893114-5c7e-4c30-8c7a-40fe61161dd1 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:39.881409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:39.882170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:39.882561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:39.883086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:39.892260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:39.894323 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:39.907905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1125/2268] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:39 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:42.783765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:42.784565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:42.784842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:42.804445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] MFA Rules not processed for user `3378945fb3734bb395995268af72960d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:42.805902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:42.817705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1144/2269] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:42 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:44.030087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:44.032179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:44.099189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39df80f-7696-49a8-8795-1863bdf0da5a service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:44.103679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:44.104573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:44.104859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:44.105133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] PATH_INFO: `/v3/users/a561148ea4c14d07a050ca8dc5787085` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:44.106321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a561148ea4c14d07a050ca8dc5787085)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:44.108278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:44.275554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a561148ea4c14d07a050ca8dc5787085'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.287824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a561148ea4c14d07a050ca8dc5787085'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.393161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a561148ea4c14d07a050ca8dc5787085'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.399360 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a561148ea4c14d07a050ca8dc5787085'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.400294 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7d3b5476-5643-4ebc-9b24-2d2c4716d779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a561148ea4c14d07a050ca8dc5787085'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.406802 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1126/2270] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:44 2021] DELETE /identity/v3/users/a561148ea4c14d07a050ca8dc5787085 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:44.682150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:44.697866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd7237-afbf-498d-be00-c610476e7210 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:44.766021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:44.766936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:44.767218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:44.767489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] PATH_INFO: `/v3/projects/ec44caf79c6e4d48a3d328a58919df19` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:44.768682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec44caf79c6e4d48a3d328a58919df19)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:44.771209 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:44.877952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec44caf79c6e4d48a3d328a58919df19', 'request_id': 'req-c39a667e-efaa-42df-82d5-689a2a88c3f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.886373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec44caf79c6e4d48a3d328a58919df19', 'request_id': 'req-c39a667e-efaa-42df-82d5-689a2a88c3f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.969809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec44caf79c6e4d48a3d328a58919df19', 'request_id': 'req-c39a667e-efaa-42df-82d5-689a2a88c3f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.980627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] The token cache is being invalidate because project ec44caf79c6e4d48a3d328a58919df19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:44.980919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.981544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c39a667e-efaa-42df-82d5-689a2a88c3f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:44.983163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1145/2271] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:44 2021] DELETE /identity/v3/projects/ec44caf79c6e4d48a3d328a58919df19 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:44.989304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:44.989622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:44.989938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.009136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:45.010379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:45.066906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1127/2272] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:45.075166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.075454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.075733 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.093990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:45.095343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:45.103200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1146/2273] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:45.107389 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.117679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f99687-be61-4b9d-8a5d-cae706f29248 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.122852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.123609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.123899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.124177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.124903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:18:45.125239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.126852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.139019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1128/2274] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:18:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:18:45.143377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.152371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ea115-d858-45e5-b2a2-8ffefa0c4bf1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.157045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.157634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.157913 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.158188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.158908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.160798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.247345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1147/2275] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:45 2021] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:45.252673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.267206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe1c25d-4ccb-4daa-b83e-07966cb8bd50 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.321077 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.321682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.321964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.322238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.322956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.324897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.421734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1129/2276] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:45 2021] POST /identity/v3/users => generated 283 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:45.425780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.437078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764513bf-746a-4ded-91b1-d2c4b0443284 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.441985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.442706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.442987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.443257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.443967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.445558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.455700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1148/2277] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:45.459623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.469435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedb1f1c-068d-4385-a73d-280995edd129 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.474545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9d35f-c53f-4226-9ee5-0682e5de1da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.475226 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9d35f-c53f-4226-9ee5-0682e5de1da6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.475509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9d35f-c53f-4226-9ee5-0682e5de1da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.475784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9d35f-c53f-4226-9ee5-0682e5de1da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.476502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9d35f-c53f-4226-9ee5-0682e5de1da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.478087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9d35f-c53f-4226-9ee5-0682e5de1da6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.487722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1130/2278] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:45.492506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.502571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac7eec-56e0-4e98-9c7e-186e22723e87 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.507279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.508096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.508378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.508639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] PATH_INFO: `/v3/projects/7e8a42c2768f4e5795a6256e2ee009d4/users/1e0ef6cb04f243eb9893372db5d2e380/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.523150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8a42c2768f4e5795a6256e2ee009d4, user_id=1e0ef6cb04f243eb9893372db5d2e380, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.525784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.605341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1149/2279] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:45 2021] PUT /identity/v3/projects/7e8a42c2768f4e5795a6256e2ee009d4/users/1e0ef6cb04f243eb9893372db5d2e380/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:45.616519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.616811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.617092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.645673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] MFA Rules not processed for user `1e0ef6cb04f243eb9893372db5d2e380`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:45.646923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:45.710859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1131/2280] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:45 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:45.715311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.779200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1fa6-80b9-465c-8866-ff0b0ae42aa8 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.783894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.784554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.784839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.785115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.786431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.788467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:45.914169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1150/2281] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:45 2021] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:45.915848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:45.926798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ab17a-e365-403d-9743-c5571cad3a87 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:45.983607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:45.984281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:45.984563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:45.984846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:45.985531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:45.987489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.078498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1132/2282] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:45 2021] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:46.080437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:46.093654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051ab47-f3e3-449d-8c71-d8cf2794f5b1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:46.098416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:46.099108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.099389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.099661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.100433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:46.102015 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.113168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1151/2283] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:46 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:46.117208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:46.139558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe38fe-c7e5-4500-8a67-f18c1e640219 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:46.144362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:46.145811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.146097 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.146371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] PATH_INFO: `/v3/projects/8fd2a578caef415f914fbb161b8d4c9c/users/05609044689e4352827677646d10de15/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.162159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2a578caef415f914fbb161b8d4c9c, user_id=05609044689e4352827677646d10de15, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:46.165238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.235270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1133/2284] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:46 2021] PUT /identity/v3/projects/8fd2a578caef415f914fbb161b8d4c9c/users/05609044689e4352827677646d10de15/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:46.239022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:46.250494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86d6e-ba9a-49d7-8a3a-e8c29d543133 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:46.309524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27365c9e-e4b8-4780-9d72-4ff6792911a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:46.310271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365c9e-e4b8-4780-9d72-4ff6792911a7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.310657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365c9e-e4b8-4780-9d72-4ff6792911a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.311002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365c9e-e4b8-4780-9d72-4ff6792911a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.311899 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27365c9e-e4b8-4780-9d72-4ff6792911a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:46.313492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27365c9e-e4b8-4780-9d72-4ff6792911a7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.327180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1152/2285] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:46 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:46.331649 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:46.349507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766bede-b40e-4d57-af23-9d5dd5fc5b80 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:46.357738 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:46.362387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.362387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.362387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] PATH_INFO: `/v3/projects/8fd2a578caef415f914fbb161b8d4c9c/users/05609044689e4352827677646d10de15/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.364413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2a578caef415f914fbb161b8d4c9c, user_id=05609044689e4352827677646d10de15, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:46.369237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.381701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1134/2286] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:46 2021] PUT /identity/v3/projects/8fd2a578caef415f914fbb161b8d4c9c/users/05609044689e4352827677646d10de15/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:46.392268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effcb87-02d2-4c1d-a665-e3eb96451f5f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.392554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effcb87-02d2-4c1d-a665-e3eb96451f5f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.392829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effcb87-02d2-4c1d-a665-e3eb96451f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.421365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-5effcb87-02d2-4c1d-a665-e3eb96451f5f None None] MFA Rules not processed for user `05609044689e4352827677646d10de15`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:46.422484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5effcb87-02d2-4c1d-a665-e3eb96451f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:46.491605 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1153/2287] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:46 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:18:46.503993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:46.507970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:46.595699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c32c15-1ab0-4939-969c-7d441e050fb9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:46.600013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:46.600670 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.600971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.601400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.610965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:46.612464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.624342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1135/2288] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:46 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:46.720625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.720625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.720625 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.739485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:46.740929 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:46.820561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1154/2289] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:18:46 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:46.837263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:46.838544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:46.932840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c53ef3-467a-480e-bc1b-89d19c8e39c0 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:46.938005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f13b93-e2ea-49bc-905b-8e8ffa579903 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:46.938692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f13b93-e2ea-49bc-905b-8e8ffa579903 service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:46.938978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f13b93-e2ea-49bc-905b-8e8ffa579903 service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:46.939262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f13b93-e2ea-49bc-905b-8e8ffa579903 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:46.947589 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f13b93-e2ea-49bc-905b-8e8ffa579903 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:46.949174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f13b93-e2ea-49bc-905b-8e8ffa579903 service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:46.958055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1136/2290] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:18:46 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 10 05:18:47.052840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:47.118720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc67e51-a1f9-4901-a57a-43516db7052c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:47.125926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:47.129471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:47.129471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:47.129808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] PATH_INFO: `/v3/users/1e0ef6cb04f243eb9893372db5d2e380` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:47.132988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0ef6cb04f243eb9893372db5d2e380)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:47.136628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:47.381383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0ef6cb04f243eb9893372db5d2e380'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:47.414964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0ef6cb04f243eb9893372db5d2e380'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:47.425057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0ef6cb04f243eb9893372db5d2e380'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:47.490453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0ef6cb04f243eb9893372db5d2e380'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:47.491454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0ef6cb04f243eb9893372db5d2e380'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:47.498347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1155/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:47 2021] DELETE /identity/v3/users/1e0ef6cb04f243eb9893372db5d2e380 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:47.503293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:47.503767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:47.503861 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:47.521665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:47.523885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:47.584910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1137/2292] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:47.594819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:47.596238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:47.653543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe725d-c358-4ea3-8106-2a235922f641 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:47.657641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:47.658371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:47.658771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:47.659097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:47.670073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:47.671694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:47.682073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1156/2293] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:48.223999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:48.225633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:48.244842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046155b-51ae-4b79-8ec9-aa4910fd3596 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:48.257452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:48.258332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:48.258686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:48.258920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] PATH_INFO: `/v3/projects/7e8a42c2768f4e5795a6256e2ee009d4` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:48.260109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8a42c2768f4e5795a6256e2ee009d4)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:48.262027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:48.361702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8a42c2768f4e5795a6256e2ee009d4', 'request_id': 'req-6ae29fd1-1e46-4a14-83cb-c60a463033b6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.368722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8a42c2768f4e5795a6256e2ee009d4', 'request_id': 'req-6ae29fd1-1e46-4a14-83cb-c60a463033b6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.430154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8a42c2768f4e5795a6256e2ee009d4', 'request_id': 'req-6ae29fd1-1e46-4a14-83cb-c60a463033b6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.440871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] The token cache is being invalidate because project 7e8a42c2768f4e5795a6256e2ee009d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:48.441157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.441772 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.443328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1138/2294] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:48 2021] DELETE /identity/v3/projects/7e8a42c2768f4e5795a6256e2ee009d4 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:48.449981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:48.461102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f6f3e-caab-444e-91a5-87c1c73718fd service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:48.519798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:48.520696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:48.520975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:48.521247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] PATH_INFO: `/v3/users/05609044689e4352827677646d10de15` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:48.522424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=05609044689e4352827677646d10de15)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:48.524832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:48.703419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05609044689e4352827677646d10de15'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.715167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05609044689e4352827677646d10de15'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.724199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05609044689e4352827677646d10de15'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.796127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05609044689e4352827677646d10de15'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.796883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-229f8f45-e029-4faf-b2cd-790810c43f2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05609044689e4352827677646d10de15'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:48.803388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1157/2295] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:48 2021] DELETE /identity/v3/users/05609044689e4352827677646d10de15 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:49.305961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:49.309504 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:49.323341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29fd1-1e46-4a14-83cb-c60a463033b6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:49.392366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:49.393273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:49.393552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:49.393827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] PATH_INFO: `/v3/projects/8fd2a578caef415f914fbb161b8d4c9c` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:49.395065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd2a578caef415f914fbb161b8d4c9c)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:49.396981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:49.501825 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd2a578caef415f914fbb161b8d4c9c', 'request_id': 'req-67b14087-f8c6-402e-b1ff-9657f91387d7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:49.512768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd2a578caef415f914fbb161b8d4c9c', 'request_id': 'req-67b14087-f8c6-402e-b1ff-9657f91387d7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:49.590184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd2a578caef415f914fbb161b8d4c9c', 'request_id': 'req-67b14087-f8c6-402e-b1ff-9657f91387d7'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:49.602994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] The token cache is being invalidate because project 8fd2a578caef415f914fbb161b8d4c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:49.603286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:49.604904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-67b14087-f8c6-402e-b1ff-9657f91387d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:49.605834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1139/2296] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:49 2021] DELETE /identity/v3/projects/8fd2a578caef415f914fbb161b8d4c9c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:49.611393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:49.612686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:49.613207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:49.647826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:49.649081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:49.712972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1158/2297] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:49.720761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:49.721055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:49.721338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:49.741126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:49.742473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:49.751351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1140/2298] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:49.755560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:49.765649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f5b44-6003-4d4e-accb-d642cd2bfcd6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:49.771055 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:49.771740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:49.772023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:49.776825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:49.776825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:18:49.776825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:49.776825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:49.793268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1159/2299] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:18:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:18:49.794527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:49.803951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba672e27-1d1a-40e7-ad8f-2b3b9aedb1e4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:49.808902 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:49.809815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:49.809933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:49.810350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:49.811163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:49.813138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:49.907198 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1141/2300] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:49 2021] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:49.915880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:49.926501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe543a77-89c2-4e98-9525-657c2f5d01e1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:50.011330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:50.038672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:50.038672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:50.038672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:50.038672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:50.038672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:50.397873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1160/2301] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:49 2021] POST /identity/v3/users => generated 294 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:50.403749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:50.417668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc649f09-d6b8-4f2e-b928-4fc8f4f1ee91 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:50.422792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:50.423493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:50.423769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:50.424046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:50.424782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:50.426957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:50.437868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1142/2302] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:50.441801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:50.454111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be66c3-52c6-4bef-b0ed-42d27648971b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:50.463904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd8008-16be-4452-879f-3fd31d61f6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:50.463904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd8008-16be-4452-879f-3fd31d61f6df admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:50.463904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd8008-16be-4452-879f-3fd31d61f6df admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:50.463904 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd8008-16be-4452-879f-3fd31d61f6df admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:50.464294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd8008-16be-4452-879f-3fd31d61f6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:50.467046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd8008-16be-4452-879f-3fd31d61f6df admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:50.483821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1161/2303] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:50 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:50.488353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:50.506247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ff609-0d12-474f-b0d6-7ff242b2c527 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:50.513934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:50.514913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:50.515194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:50.515468 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] PATH_INFO: `/v3/projects/4d643e04a3a74e97ab3f92534447a0b2/users/7733790d751a4a97b054ca56f836046b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:50.531984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d643e04a3a74e97ab3f92534447a0b2, user_id=7733790d751a4a97b054ca56f836046b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:50.534889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:50.721687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1143/2304] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:50 2021] PUT /identity/v3/projects/4d643e04a3a74e97ab3f92534447a0b2/users/7733790d751a4a97b054ca56f836046b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:50.734274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:50.734906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:50.734906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:50.761917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] MFA Rules not processed for user `7733790d751a4a97b054ca56f836046b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:50.763163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:50.833801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1162/2305] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:50 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:50.837988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:50.919089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de575175-43c6-4b85-969b-fff910a78727 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:50.924161 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:50.929585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:50.929884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:50.930162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:50.930939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:50.933182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.100923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1144/2306] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:50 2021] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:18:51.128494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:51.143222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0fce8-f7d4-410a-bcc9-0ffcd76e6df2 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:51.231049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:51.231814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.232111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.232392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.233524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:51.236329 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.358691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1163/2307] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:51 2021] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:51.362143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:51.376798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143719e-dbcb-4b26-aaaf-e2faf02f2767 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:51.382206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:51.382963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.383275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.383514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.384242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:51.385840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.397213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1145/2308] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:51.401502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:51.412121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ea8f73-5bd3-4e04-9462-1db800dbd7cd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:51.417389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:51.418348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.418746 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.419092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] PATH_INFO: `/v3/projects/388e3d318f574746899648cd5eefdb6a/users/41f67a4852b74118a497971f1ad15123/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.435784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=388e3d318f574746899648cd5eefdb6a, user_id=41f67a4852b74118a497971f1ad15123, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:51.437602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.508658 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1164/2309] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:51 2021] PUT /identity/v3/projects/388e3d318f574746899648cd5eefdb6a/users/41f67a4852b74118a497971f1ad15123/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:51.540799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:51.545826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649926fb-d336-4f21-a942-e86691820f82 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:51.623611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93537d-8a51-4ef4-bde4-d8aa4d945d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:51.624216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93537d-8a51-4ef4-bde4-d8aa4d945d25 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.624498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93537d-8a51-4ef4-bde4-d8aa4d945d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.624775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93537d-8a51-4ef4-bde4-d8aa4d945d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.625505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93537d-8a51-4ef4-bde4-d8aa4d945d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:51.627256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93537d-8a51-4ef4-bde4-d8aa4d945d25 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.647176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1146/2310] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:51 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:51.650919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:51.665725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61a684-957b-412b-ad4e-63780d7232fd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:51.671457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:51.672450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.672811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.673164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] PATH_INFO: `/v3/projects/388e3d318f574746899648cd5eefdb6a/users/41f67a4852b74118a497971f1ad15123/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.675377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=388e3d318f574746899648cd5eefdb6a, user_id=41f67a4852b74118a497971f1ad15123, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:51.679675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.690177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1165/2311] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:51 2021] PUT /identity/v3/projects/388e3d318f574746899648cd5eefdb6a/users/41f67a4852b74118a497971f1ad15123/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:51.700730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.701030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.701338 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.735960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] MFA Rules not processed for user `41f67a4852b74118a497971f1ad15123`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:51.739388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:51.814526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1147/2312] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:51 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:51.827105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:51.828942 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:51.893883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be2c1f-ee58-4ff5-831c-3faa62b12f22 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:51.897671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7eb3-b4d6-40b6-8c9b-65b4bcea4aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:51.898318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7eb3-b4d6-40b6-8c9b-65b4bcea4aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:51.898626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7eb3-b4d6-40b6-8c9b-65b4bcea4aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:51.898906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7eb3-b4d6-40b6-8c9b-65b4bcea4aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:51.908343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7eb3-b4d6-40b6-8c9b-65b4bcea4aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:51.909800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7eb3-b4d6-40b6-8c9b-65b4bcea4aa9 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:51.919264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1166/2313] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:51 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:51.990445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:52.055777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2dc9b-feec-4704-858f-6a0c5f37c91c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:52.060850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:52.061765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:52.062196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:52.062470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] PATH_INFO: `/v3/users/7733790d751a4a97b054ca56f836046b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:52.063819 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7733790d751a4a97b054ca56f836046b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:52.065757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:52.563526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7733790d751a4a97b054ca56f836046b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:52.576518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7733790d751a4a97b054ca56f836046b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:52.655974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7733790d751a4a97b054ca56f836046b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:52.664367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7733790d751a4a97b054ca56f836046b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:52.665536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7733790d751a4a97b054ca56f836046b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:52.672028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1148/2314] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:51 2021] DELETE /identity/v3/users/7733790d751a4a97b054ca56f836046b => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:52.677150 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:52.677719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:52.678030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:52.702918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:52.704076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:52.774517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1167/2315] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:18:52.785010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:52.786981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:52.848762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4233e5d3-88a4-4c10-9559-bf4d84e69abe admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:52.852677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:52.853350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:52.853782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:52.854067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:52.864786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:52.866237 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:52.881353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1149/2316] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:18:53.391595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:53.393131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:53.406023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4d1f8-65ac-46f9-a122-aae5472f7fe6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:53.411143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:53.412126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:53.412506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:53.412877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] PATH_INFO: `/v3/projects/4d643e04a3a74e97ab3f92534447a0b2` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:53.414182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d643e04a3a74e97ab3f92534447a0b2)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:53.416342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:53.533762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d643e04a3a74e97ab3f92534447a0b2', 'request_id': 'req-d1d141c2-746e-49b1-8eed-ecfa450c8c60'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:53.540232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d643e04a3a74e97ab3f92534447a0b2', 'request_id': 'req-d1d141c2-746e-49b1-8eed-ecfa450c8c60'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:53.610167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d643e04a3a74e97ab3f92534447a0b2', 'request_id': 'req-d1d141c2-746e-49b1-8eed-ecfa450c8c60'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:53.621845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] The token cache is being invalidate because project 4d643e04a3a74e97ab3f92534447a0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:53.622137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:53.622797 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:53.624351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1168/2317] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:53 2021] DELETE /identity/v3/projects/4d643e04a3a74e97ab3f92534447a0b2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:53.628368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:53.637858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6b663-dfe0-4d7c-9dd1-2b771bc2582b service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:53.695178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:53.696243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:53.696821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:53.697228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] PATH_INFO: `/v3/users/41f67a4852b74118a497971f1ad15123` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:53.698827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f67a4852b74118a497971f1ad15123)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:53.701238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:54.189231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f67a4852b74118a497971f1ad15123'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:54.200947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f67a4852b74118a497971f1ad15123'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:54.301457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f67a4852b74118a497971f1ad15123'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:54.309795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f67a4852b74118a497971f1ad15123'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:54.312470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-41ab2bb9-c08c-46a2-9d5e-af45496e387c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f67a4852b74118a497971f1ad15123'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:54.320421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1150/2318] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:18:53 2021] DELETE /identity/v3/users/41f67a4852b74118a497971f1ad15123 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:54.755796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:54.757449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:54.772526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d141c2-746e-49b1-8eed-ecfa450c8c60 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:54.835493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:54.836578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:54.837023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:54.837377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] PATH_INFO: `/v3/projects/388e3d318f574746899648cd5eefdb6a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:54.838641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=388e3d318f574746899648cd5eefdb6a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:54.840593 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:54.955353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '388e3d318f574746899648cd5eefdb6a', 'request_id': 'req-7965ae40-d98e-4ef8-8562-c9540a6b1546'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:54.961571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '388e3d318f574746899648cd5eefdb6a', 'request_id': 'req-7965ae40-d98e-4ef8-8562-c9540a6b1546'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:55.033124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '388e3d318f574746899648cd5eefdb6a', 'request_id': 'req-7965ae40-d98e-4ef8-8562-c9540a6b1546'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:55.045102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] The token cache is being invalidate because project 388e3d318f574746899648cd5eefdb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:18:55.045670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:55.046698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7965ae40-d98e-4ef8-8562-c9540a6b1546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:18:55.048518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1169/2319] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:18:54 2021] DELETE /identity/v3/projects/388e3d318f574746899648cd5eefdb6a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:55.055839 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.056381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.056536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.077503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:55.078750 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:55.154060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1151/2320] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:55.160743 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.161323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.161705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.184462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:55.186021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:55.200229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1170/2321] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:55.201406 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.215091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d201c4-4640-4e0e-b195-36b341ec9e59 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.222108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.223435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.224124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.224124 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.224685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:18:55.224993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.226607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:55.241998 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1152/2322] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:18:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:18:55.247294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.254967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf932b51-7d53-42af-be53-a89a1f25e512 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.259823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.260505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.260788 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.261062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.261780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.263945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:55.353243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1171/2323] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:55 2021] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:55.357188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.368076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d805c4b-0c0a-4da0-8e5e-5d7405426c69 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.428083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.428855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.429209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.429554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.430308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.432348 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:55.551433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1153/2324] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:55 2021] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:18:55.553704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.588292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862613a-2fac-4775-8655-c09e1faae1e2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.593478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.594013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.594110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.594481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.595314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.596993 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:55.610893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1172/2325] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:55 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:55.612298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.623287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15bb6a-b069-4a51-bd55-ff287457fad8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.629968 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1927a75-6d66-40c8-96a3-dccd92c47253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.630814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927a75-6d66-40c8-96a3-dccd92c47253 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.631162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927a75-6d66-40c8-96a3-dccd92c47253 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.631501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927a75-6d66-40c8-96a3-dccd92c47253 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.632290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1927a75-6d66-40c8-96a3-dccd92c47253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.633980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1927a75-6d66-40c8-96a3-dccd92c47253 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:55.644079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1154/2326] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:55.651843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.662134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e21a1-c0c0-47dc-8ed8-24de01176c20 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.674907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.676316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.676623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.676895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] PATH_INFO: `/v3/projects/a8924bad3f1a4a7a850e839a4fa04814/users/acb80bdc3c054ef494a1ecc699dbf1ec/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.696194 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8924bad3f1a4a7a850e839a4fa04814, user_id=acb80bdc3c054ef494a1ecc699dbf1ec, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.699226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:55.766843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1173/2327] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:55 2021] PUT /identity/v3/projects/a8924bad3f1a4a7a850e839a4fa04814/users/acb80bdc3c054ef494a1ecc699dbf1ec/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:55.778267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.778702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.779065 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.808175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] MFA Rules not processed for user `acb80bdc3c054ef494a1ecc699dbf1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:55.813152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:55.876999 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1155/2328] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:55.881504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:55.950020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f14a5-35f8-4445-b02f-33bd151d0a60 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:55.955062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:55.955710 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:55.955998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:55.956272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:55.956978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:55.959131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:56.060556 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1174/2329] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:55 2021] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:18:56.064288 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:56.076511 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcbfc7-ff91-4769-816c-05d10783449d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:56.135387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:56.136297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.136573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.137044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.137768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:56.139773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:56.303629 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1156/2330] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:56 2021] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:56.307612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:56.319332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d8900-d646-4ff7-98bb-6cd3c8e0af05 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:56.325603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:56.326599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.327140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.327624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.328909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:56.331450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:56.356953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1175/2331] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:56.361042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:56.371722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e1705-3805-43c2-8ee0-1c254db043c9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:56.376451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8457374-4b9c-47c0-8d0c-0965bb49fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:56.377133 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8457374-4b9c-47c0-8d0c-0965bb49fea8 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.377420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8457374-4b9c-47c0-8d0c-0965bb49fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.377701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8457374-4b9c-47c0-8d0c-0965bb49fea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.378434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8457374-4b9c-47c0-8d0c-0965bb49fea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:56.382290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8457374-4b9c-47c0-8d0c-0965bb49fea8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:56.394060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1157/2332] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:56.398866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:56.418807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1784cc-e604-4400-95ab-cd2c49cfa5b3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:56.428287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:56.429561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.430335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.431359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] PATH_INFO: `/v3/projects/e4f6d016bfe042fa80c289516740592c/users/4872fd30c94641f4862b840d3c3e5911/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.450310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4f6d016bfe042fa80c289516740592c, user_id=4872fd30c94641f4862b840d3c3e5911, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:56.453843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:56.538653 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1176/2333] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:56 2021] PUT /identity/v3/projects/e4f6d016bfe042fa80c289516740592c/users/4872fd30c94641f4862b840d3c3e5911/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:56.548484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.548820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.549046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.575465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] MFA Rules not processed for user `4872fd30c94641f4862b840d3c3e5911`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:56.576658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:56.664537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1158/2334] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:56 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:56.669340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:56.761998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ea655-9ff9-498b-82a0-35cc933704f1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:56.768074 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:56.768768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.769016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.769300 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.770735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:56.772524 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:56.881621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1177/2335] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:18:56 2021] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:56.885723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:56.897820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c517df1-a213-47ae-996f-d15277426b16 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:56.960009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:56.960719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:56.961150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:56.961462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:56.967462 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:56.970809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:57.527673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1159/2336] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:18:56 2021] POST /identity/v3/users => generated 299 bytes in 640 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:18:57.530134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:57.541127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4391f610-98e6-40c0-972a-32fe1bc8da24 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:57.545864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:57.546689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:57.547038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:57.547380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:57.548419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:57.550164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:57.564906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1178/2337] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:57 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:18:57.572978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:57.583966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59db110-a58e-44ce-acb3-854a2b45ee14 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:57.599710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:57.600725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:57.601075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:57.601419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] PATH_INFO: `/v3/projects/514630f09ee74896a53b3ca16fa6a1fa/users/2900b164f23a4f2abd7d955016402fae/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:57.632891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=514630f09ee74896a53b3ca16fa6a1fa, user_id=2900b164f23a4f2abd7d955016402fae, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:57.635562 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:57.731940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1160/2338] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:57 2021] PUT /identity/v3/projects/514630f09ee74896a53b3ca16fa6a1fa/users/2900b164f23a4f2abd7d955016402fae/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:18:57.732704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:57.748794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa7254-fad6-488b-acf1-6ee0e00850b6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:57.812192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbc39e-0c60-4a6e-a66e-93aa754b3abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:57.812922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc39e-0c60-4a6e-a66e-93aa754b3abd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:57.813075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc39e-0c60-4a6e-a66e-93aa754b3abd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:57.813343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc39e-0c60-4a6e-a66e-93aa754b3abd admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:57.814350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbc39e-0c60-4a6e-a66e-93aa754b3abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:57.816149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbc39e-0c60-4a6e-a66e-93aa754b3abd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:57.832783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1179/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:18:57 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:18:57.833985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:57.844493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772aa6e6-4a85-44a8-8be4-74dbc914e89d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:57.849743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:57.850692 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:57.851005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:57.851284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] PATH_INFO: `/v3/projects/514630f09ee74896a53b3ca16fa6a1fa/users/2900b164f23a4f2abd7d955016402fae/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:57.853234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=514630f09ee74896a53b3ca16fa6a1fa, user_id=2900b164f23a4f2abd7d955016402fae, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:57.855883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:57.866037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1161/2340] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:18:57 2021] PUT /identity/v3/projects/514630f09ee74896a53b3ca16fa6a1fa/users/2900b164f23a4f2abd7d955016402fae/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:18:57.876414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:57.876715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:57.877002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:57.906529 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] MFA Rules not processed for user `2900b164f23a4f2abd7d955016402fae`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:18:57.907809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:57.983188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1180/2341] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:18:57 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:18:57.995700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:57.997964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:58.058231 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6088e-965c-47c2-b853-f14a686ff23c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:58.061954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:58.062688 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:58.062913 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:58.063219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:58.072687 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:58.074107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:58.088232 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1162/2342] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:57 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:18:59.688800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:18:59.690336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:18:59.702334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1da44-ff8a-493a-8317-8d5a948f06c5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:18:59.706209 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:18:59.706927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:18:59.707212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:18:59.707508 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:18:59.762178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:18:59.763639 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:18:59.772252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1181/2343] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:18:59 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:01.153743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:01.155265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:01.250087 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289f375-9e13-4589-9b85-d24e5f01f6b2 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:01.255293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:01.255938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:01.256221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:01.256498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:01.258229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:01.269975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:01.271775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082711a-2cb9-4530-af9b-fcae85b903b8 service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:01.281514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1163/2344] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:01 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:02.600234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:02.601623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:02.664115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6b608-204c-4659-9a07-9cd6172911c6 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:02.668656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:02.669518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:02.669800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:02.670071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] PATH_INFO: `/v3/users/f9f2e8b728ab4a94804c147c1334c62b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:02.671259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f2e8b728ab4a94804c147c1334c62b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:02.673162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:02.835375 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f2e8b728ab4a94804c147c1334c62b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:02.846842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f2e8b728ab4a94804c147c1334c62b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:02.854036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f2e8b728ab4a94804c147c1334c62b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:02.923513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f2e8b728ab4a94804c147c1334c62b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:02.924125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f2e8b728ab4a94804c147c1334c62b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:02.931403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1182/2345] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:02 2021] DELETE /identity/v3/users/f9f2e8b728ab4a94804c147c1334c62b => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:02.936154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:02.936683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:02.936832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:02.954228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:02.955549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:03.013701 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1164/2346] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:03.024388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:03.025916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:03.083947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de15cc-a89c-4d44-bb1b-eccb38df14cf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:03.087781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57df45a1-1439-4289-b47b-887bf8d7671e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:03.088429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df45a1-1439-4289-b47b-887bf8d7671e service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:03.088714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df45a1-1439-4289-b47b-887bf8d7671e service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:03.088993 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57df45a1-1439-4289-b47b-887bf8d7671e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:03.098811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df45a1-1439-4289-b47b-887bf8d7671e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:03.100290 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57df45a1-1439-4289-b47b-887bf8d7671e service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:03.109753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1183/2347] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:03.533414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:03.535582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:03.552375 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf94b71-3b07-4005-88ff-15a0e3405694 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:03.556175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:03.568240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:03.568240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:03.568240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] PATH_INFO: `/v3/projects/9dc3d5d89cee410baeeb0f5b370e9128` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:03.568240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc3d5d89cee410baeeb0f5b370e9128)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:03.568240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:03.668722 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc3d5d89cee410baeeb0f5b370e9128', 'request_id': 'req-79cd225c-2199-4b64-bfaa-15ad90b97012'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:03.674698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc3d5d89cee410baeeb0f5b370e9128', 'request_id': 'req-79cd225c-2199-4b64-bfaa-15ad90b97012'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:03.754221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc3d5d89cee410baeeb0f5b370e9128', 'request_id': 'req-79cd225c-2199-4b64-bfaa-15ad90b97012'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:03.764259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] The token cache is being invalidate because project 9dc3d5d89cee410baeeb0f5b370e9128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:03.764545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:03.765159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-79cd225c-2199-4b64-bfaa-15ad90b97012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:03.769304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1165/2348] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:03 2021] DELETE /identity/v3/projects/9dc3d5d89cee410baeeb0f5b370e9128 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:03.773382 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:03.773835 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:03.773925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:03.792690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:03.793880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:03.849172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1184/2349] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:03.856650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:03.856946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:03.857224 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:03.875548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:03.876725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:03.884519 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1166/2350] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:03.888428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:03.898105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87061b25-e6e6-4f23-a57f-2f884096ec29 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:03.902682 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:03.903324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:03.903604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:03.903874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:03.904585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:03.904885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:03.906471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:03.918465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1185/2351] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:19:03.927824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:03.937268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdf314-2450-46d6-bd57-94cb5807a19c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:03.941966 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:03.942646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:03.942931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:03.943207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:03.943972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:03.945867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.039371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1167/2352] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:03 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:04.043500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:04.053525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a2dc8-a637-4746-9ed9-1d0614d8a278 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:04.109170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:04.109840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.110118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.110392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.111110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:04.113040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.210208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1186/2353] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:04 2021] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:04.214301 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:04.224767 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8ba4c-07a8-4a6f-a528-8be0b9267d2e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:04.230034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:04.230735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.231027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.231387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.232118 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:04.233774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.244755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1168/2354] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:04.248754 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:04.259090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a595f5-ea4b-4003-b2f6-c567b851a41c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:04.263690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd9daf4-12d2-4d81-95a2-aef717f0921f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:04.264333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9daf4-12d2-4d81-95a2-aef717f0921f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.264614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9daf4-12d2-4d81-95a2-aef717f0921f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.264891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd9daf4-12d2-4d81-95a2-aef717f0921f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.265601 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9daf4-12d2-4d81-95a2-aef717f0921f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:04.267253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd9daf4-12d2-4d81-95a2-aef717f0921f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.277439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1187/2355] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:04.281390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:04.291491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e81e8a-6dbd-41c4-8964-41365a6c6f14 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:04.296190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:04.297126 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.297407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.297677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] PATH_INFO: `/v3/projects/9f517c47aa0e4419bd46c259115a3d96/users/d8d128d0505347fe85e1de4fb82e50b5/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.311756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f517c47aa0e4419bd46c259115a3d96, user_id=d8d128d0505347fe85e1de4fb82e50b5, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:04.314387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.412190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1169/2356] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:04 2021] PUT /identity/v3/projects/9f517c47aa0e4419bd46c259115a3d96/users/d8d128d0505347fe85e1de4fb82e50b5/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:04.422391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.422713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.422996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.451315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] MFA Rules not processed for user `d8d128d0505347fe85e1de4fb82e50b5`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:04.452577 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:04.520834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1188/2357] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:04 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:04.527933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:04.529691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:04.588823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57891-31f7-4705-8e30-866b46a184bb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:04.593545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:04.594020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.594374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.594756 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.603736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:04.605255 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.615265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1170/2358] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:04 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:04.772983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:04.774552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:04.786409 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfcef6-1953-4d2c-98b6-362f1dae8910 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:04.790026 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:04.800558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:04.800558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:04.800558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:04.800558 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:04.849712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:04.851093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb53c8-eb7a-44d7-ad9b-522d8a9d03a4 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:04.859752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1189/2359] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:04 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:07.700401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:07.763875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084138aa-bf64-489e-8a62-6aabcde9f53a service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:07.769400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:07.770369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:07.770702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:07.770978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] PATH_INFO: `/v3/users/d8d128d0505347fe85e1de4fb82e50b5` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:07.774292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d128d0505347fe85e1de4fb82e50b5)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:07.774292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:07.977452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d128d0505347fe85e1de4fb82e50b5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:07.989056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d128d0505347fe85e1de4fb82e50b5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:08.084084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d128d0505347fe85e1de4fb82e50b5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:08.091635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d128d0505347fe85e1de4fb82e50b5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:08.092463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d128d0505347fe85e1de4fb82e50b5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:08.099828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1171/2360] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:07 2021] DELETE /identity/v3/users/d8d128d0505347fe85e1de4fb82e50b5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:08.104502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:08.105006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:08.105106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:08.123539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:08.124969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:08.184721 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1190/2361] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:08.194182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:08.195705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:08.254307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefb634-f565-4b3d-bd23-1c7a8add9992 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:08.258120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396014ec-68d3-482e-be2c-b67dcb3ba739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:08.258796 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396014ec-68d3-482e-be2c-b67dcb3ba739 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:08.259217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396014ec-68d3-482e-be2c-b67dcb3ba739 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:08.259427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396014ec-68d3-482e-be2c-b67dcb3ba739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:08.268484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396014ec-68d3-482e-be2c-b67dcb3ba739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:08.270458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396014ec-68d3-482e-be2c-b67dcb3ba739 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:08.281155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1172/2362] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:08.825280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:08.826796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:08.839486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d282bb-9e7c-4fdd-990e-d220bc763af8 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:08.844121 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:08.845044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:08.845318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:08.845595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] PATH_INFO: `/v3/projects/9f517c47aa0e4419bd46c259115a3d96` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:08.846810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f517c47aa0e4419bd46c259115a3d96)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:08.848729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:08.960005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f517c47aa0e4419bd46c259115a3d96', 'request_id': 'req-c6f68a29-d4f5-4719-a9bd-b891d11820be'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:08.966051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f517c47aa0e4419bd46c259115a3d96', 'request_id': 'req-c6f68a29-d4f5-4719-a9bd-b891d11820be'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.086060 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f517c47aa0e4419bd46c259115a3d96', 'request_id': 'req-c6f68a29-d4f5-4719-a9bd-b891d11820be'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.096698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] The token cache is being invalidate because project 9f517c47aa0e4419bd46c259115a3d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:09.096985 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.097630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c6f68a29-d4f5-4719-a9bd-b891d11820be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.099272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1191/2363] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:08 2021] DELETE /identity/v3/projects/9f517c47aa0e4419bd46c259115a3d96 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:09.104847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.105314 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.105427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.124956 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:09.126151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.191292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1173/2364] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:09.193672 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.194133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.194226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.213538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:09.215413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.224973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1192/2365] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:09.228981 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.239777 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a68e0-bbd7-4fa8-a757-d731d88e464c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.245180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.245871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.246112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.246398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.247147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:09.247454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.249092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.262749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1174/2366] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:19:09.263469 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.265001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.265669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.278243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d975fd-d545-4d30-bae2-659dc28946e9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.280365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c04a22-391c-4635-9146-45655a249708 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.283827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.284741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.285586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.285807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.285936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] PATH_INFO: `/v3/users/acb80bdc3c054ef494a1ecc699dbf1ec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.286430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.286725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.286996 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.287118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb80bdc3c054ef494a1ecc699dbf1ec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.287714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.289063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.289611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.402265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1175/2367] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:09 2021] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:09.403334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.464607 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fbea68-1939-4739-addc-58f5ad1eee59 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.469386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.470093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.470377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.470679 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.471370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.473828 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.514167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb80bdc3c054ef494a1ecc699dbf1ec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.536414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb80bdc3c054ef494a1ecc699dbf1ec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.543644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb80bdc3c054ef494a1ecc699dbf1ec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.560846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1176/2368] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:09 2021] POST /identity/v3/users => generated 283 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:09.565792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.574708 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa219b89-7368-40d3-95bd-29f2973f4376 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.579512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.580280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.580627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.580907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.581751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.583420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.593980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1177/2369] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:09.598396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.607831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c751a-ed5b-4dd5-ae0e-e908fd763d58 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.612518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.613754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.614036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.614311 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.615069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.619076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.626723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1178/2370] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:09 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:09.630593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.637268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb80bdc3c054ef494a1ecc699dbf1ec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.637909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5753733-52a9-4f99-94f9-f0b1db2baddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb80bdc3c054ef494a1ecc699dbf1ec'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:09.640868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e7db2-2883-4485-888a-9d0ef715d431 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.647994 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1193/2371] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:09 2021] DELETE /identity/v3/users/acb80bdc3c054ef494a1ecc699dbf1ec => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:19:09.648092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd162302-5c27-45e6-920a-8a2c15001454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.648092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162302-5c27-45e6-920a-8a2c15001454 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.648092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162302-5c27-45e6-920a-8a2c15001454 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.648092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd162302-5c27-45e6-920a-8a2c15001454 admin admin] PATH_INFO: `/v3/projects/b52bb41e88f54ec2abf8213026a61089/users/bdda75f6d0f34bb2b198d8b3a8912a24/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.651030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.651442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.651951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.664110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162302-5c27-45e6-920a-8a2c15001454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52bb41e88f54ec2abf8213026a61089, user_id=bdda75f6d0f34bb2b198d8b3a8912a24, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.666984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd162302-5c27-45e6-920a-8a2c15001454 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.669792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:09.671111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.744725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1194/2372] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:19:09.754976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.756424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.763784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1179/2373] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:09 2021] PUT /identity/v3/projects/b52bb41e88f54ec2abf8213026a61089/users/bdda75f6d0f34bb2b198d8b3a8912a24/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:19:09.781974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.782266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.782543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.814611 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] MFA Rules not processed for user `bdda75f6d0f34bb2b198d8b3a8912a24`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:09.815915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.834830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553b880-5c59-48b8-a4a2-f1cf7ffd8d88 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.902288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.902975 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.903258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.906702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.906857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1180/2374] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:09 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:19:09.922148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:09.927660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:09.976102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:09.977665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:09.989624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79318182-b3fa-473f-8a99-2755de789fdc None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:09.994177 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:09.994870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:09.995151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:09.995421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:09.997131 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1195/2375] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:19:10.007884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:10.013823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:10.027686 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1181/2376] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:09 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:19:10.511425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:10.512917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:10.529493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f6eb1-779d-4919-a217-06a94027568d service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:10.539511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:10.540626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:10.540920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:10.541352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] PATH_INFO: `/v3/projects/a8924bad3f1a4a7a850e839a4fa04814` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:10.543417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8924bad3f1a4a7a850e839a4fa04814)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:10.545752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:10.690457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8924bad3f1a4a7a850e839a4fa04814', 'request_id': 'req-781ac80b-0915-421e-828f-06b28f17a38e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:10.697352 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8924bad3f1a4a7a850e839a4fa04814', 'request_id': 'req-781ac80b-0915-421e-828f-06b28f17a38e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:10.791865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8924bad3f1a4a7a850e839a4fa04814', 'request_id': 'req-781ac80b-0915-421e-828f-06b28f17a38e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:10.802451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] The token cache is being invalidate because project a8924bad3f1a4a7a850e839a4fa04814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:10.802781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:10.803402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-781ac80b-0915-421e-828f-06b28f17a38e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:10.804935 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1196/2377] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:10 2021] DELETE /identity/v3/projects/a8924bad3f1a4a7a850e839a4fa04814 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:10.808984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:10.820461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9437266-1e80-4e89-9424-cbad98af27cb service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:10.886499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:10.887635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:10.887917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:10.888192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] PATH_INFO: `/v3/users/4872fd30c94641f4862b840d3c3e5911` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:10.889391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4872fd30c94641f4862b840d3c3e5911)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:10.891368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:11.128342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4872fd30c94641f4862b840d3c3e5911'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:11.140881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4872fd30c94641f4862b840d3c3e5911'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:11.230025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4872fd30c94641f4862b840d3c3e5911'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:11.239502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4872fd30c94641f4862b840d3c3e5911'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:11.240205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4872fd30c94641f4862b840d3c3e5911'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:11.246742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1182/2378] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:10 2021] DELETE /identity/v3/users/4872fd30c94641f4862b840d3c3e5911 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:11.286636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:11.286930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:11.287208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:11.360851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:11.362096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:11.447749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1197/2379] 10.222.0.16 () {58 vars in 968 bytes} [Tue Aug 10 05:19:11 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:11.472745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:11.474992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:11.584405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3c63a-cb9d-4098-ae8e-7935901ee2b4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:11.590326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:11.595104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:11.595104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:11.595104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:11.601698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:11.603560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:11.617239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1183/2380] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:19:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:19:11.747829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:11.749294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:11.819322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcf031-4874-424d-b8e6-75c1b09dc7ad None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:11.823986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:11.824846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:11.825128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:11.825400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] PATH_INFO: `/v3/projects/e4f6d016bfe042fa80c289516740592c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:11.826568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4f6d016bfe042fa80c289516740592c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:11.828527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:11.969439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4f6d016bfe042fa80c289516740592c', 'request_id': 'req-d84b6059-7516-47b4-b089-1650120e6146'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:11.988790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4f6d016bfe042fa80c289516740592c', 'request_id': 'req-d84b6059-7516-47b4-b089-1650120e6146'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.062977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4f6d016bfe042fa80c289516740592c', 'request_id': 'req-d84b6059-7516-47b4-b089-1650120e6146'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.075865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] The token cache is being invalidate because project e4f6d016bfe042fa80c289516740592c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:12.076328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.077000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.078616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1198/2381] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:11 2021] DELETE /identity/v3/projects/e4f6d016bfe042fa80c289516740592c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:12.084411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:12.100691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3a715-859b-46bd-bb46-9bd91565c75e service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:12.185800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:12.189016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:12.189529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:12.189886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] PATH_INFO: `/v3/users/2900b164f23a4f2abd7d955016402fae` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:12.193117 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2900b164f23a4f2abd7d955016402fae)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:12.195963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:12.443795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2900b164f23a4f2abd7d955016402fae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.460539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2900b164f23a4f2abd7d955016402fae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.553858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2900b164f23a4f2abd7d955016402fae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.561769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2900b164f23a4f2abd7d955016402fae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.562441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-fec8688a-c9ba-45e8-b0b6-1032e3cb409f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2900b164f23a4f2abd7d955016402fae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:12.568765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1184/2382] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:12 2021] DELETE /identity/v3/users/2900b164f23a4f2abd7d955016402fae => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:13.121317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.121814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:13.137034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b6059-7516-47b4-b089-1650120e6146 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.204359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.205326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.205611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.205886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] PATH_INFO: `/v3/projects/514630f09ee74896a53b3ca16fa6a1fa` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.207638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=514630f09ee74896a53b3ca16fa6a1fa)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.209554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.336466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514630f09ee74896a53b3ca16fa6a1fa', 'request_id': 'req-66ab9f4d-eb5d-4cbf-8442-928c491c5842'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:13.342602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514630f09ee74896a53b3ca16fa6a1fa', 'request_id': 'req-66ab9f4d-eb5d-4cbf-8442-928c491c5842'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:13.405204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514630f09ee74896a53b3ca16fa6a1fa', 'request_id': 'req-66ab9f4d-eb5d-4cbf-8442-928c491c5842'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:13.415862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] The token cache is being invalidate because project 514630f09ee74896a53b3ca16fa6a1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:13.416147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:13.416764 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-66ab9f4d-eb5d-4cbf-8442-928c491c5842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:13.418281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1199/2383] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:13 2021] DELETE /identity/v3/projects/514630f09ee74896a53b3ca16fa6a1fa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:19:13.425160 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296033fd-cc60-432e-902d-756b45387365 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.426189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296033fd-cc60-432e-902d-756b45387365 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.426337 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296033fd-cc60-432e-902d-756b45387365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.445241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-296033fd-cc60-432e-902d-756b45387365 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:13.446704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-296033fd-cc60-432e-902d-756b45387365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:13.507129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1185/2384] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:19:13.515327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.515618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.515896 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.535998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:13.537294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:13.545792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1200/2385] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:13.549936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296033fd-cc60-432e-902d-756b45387365 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.560191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296033fd-cc60-432e-902d-756b45387365 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.564798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.565454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.565739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.566667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.567398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:13.567733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.569356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.580695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1186/2386] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:19:13.585028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.594120 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f467e-7ca5-479b-91ec-d041d0d9f8c9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.598709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.599351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.599630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.599898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.600588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.602463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.671881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1201/2387] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:13 2021] POST /identity/v3/projects => generated 393 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:13.676552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.686707 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120867a-6be1-4a6b-b268-6ecef83a7b8b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.740369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.741069 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.741355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.741726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.742430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.744723 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.819638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1187/2388] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:13 2021] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:13.823704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.833811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259151b-f3af-4600-bdfe-6e6e2a9def21 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.838424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693350-6628-4844-9343-293ff3248144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.839187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693350-6628-4844-9343-293ff3248144 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.839472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693350-6628-4844-9343-293ff3248144 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.839747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63693350-6628-4844-9343-293ff3248144 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.840461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63693350-6628-4844-9343-293ff3248144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.842097 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63693350-6628-4844-9343-293ff3248144 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.852756 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1202/2389] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:13.856799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.867200 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fe74f-4093-4b18-8a27-5dd6c084342d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.872029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8e2c6-f1d3-4e11-8671-713b9c6a421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.872676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8e2c6-f1d3-4e11-8671-713b9c6a421a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.872959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8e2c6-f1d3-4e11-8671-713b9c6a421a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.873236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8e2c6-f1d3-4e11-8671-713b9c6a421a admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.873953 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8e2c6-f1d3-4e11-8671-713b9c6a421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.875595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8e2c6-f1d3-4e11-8671-713b9c6a421a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.885042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1188/2390] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:13.888997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693350-6628-4844-9343-293ff3248144 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:13.898569 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63693350-6628-4844-9343-293ff3248144 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:13.903085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:13.903939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:13.904221 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:13.904494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] PATH_INFO: `/v3/projects/7b1a30355fef4fda83698ab169c6bc41/users/b3ceb2f6fe7e41b99cd446ec28c9b4ef/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:13.918720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1a30355fef4fda83698ab169c6bc41, user_id=b3ceb2f6fe7e41b99cd446ec28c9b4ef, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:13.921359 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:13.997665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1203/2391] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:13 2021] PUT /identity/v3/projects/7b1a30355fef4fda83698ab169c6bc41/users/b3ceb2f6fe7e41b99cd446ec28c9b4ef/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:14.008847 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.009140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.009441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.037334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] MFA Rules not processed for user `b3ceb2f6fe7e41b99cd446ec28c9b4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:14.038552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:14.108798 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1189/2392] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:14 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:14.113850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.175062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ccd73-bc95-43cb-a7e1-134e2c013888 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.181620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.182383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.182719 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.183032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.183757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.185729 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.330063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1204/2393] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:14 2021] POST /identity/v3/projects => generated 393 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:14.335201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.345730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675c0dd-d80b-4f34-aa0f-74b15f2acd9a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.399178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.399781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.400064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.400342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.401037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.403042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.521480 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1190/2394] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:14 2021] POST /identity/v3/users => generated 303 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:14.525505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.536620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc2414-3899-41fc-a490-6d5b543869ca admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.541314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.541973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.542254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.542527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.543277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.544948 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.555923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1205/2395] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:14.564447 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.575148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66dabf-47ad-4761-a9f7-5f74d8d4059b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.579702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.580585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.580862 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.581130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] PATH_INFO: `/v3/projects/bdfa7de840384387ad50dcfbfecbf90b/users/ad2aea2c76b0476992e4ff2e9008666c/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.596171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfa7de840384387ad50dcfbfecbf90b, user_id=ad2aea2c76b0476992e4ff2e9008666c, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.598835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.677455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1191/2396] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:14 2021] PUT /identity/v3/projects/bdfa7de840384387ad50dcfbfecbf90b/users/ad2aea2c76b0476992e4ff2e9008666c/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:14.678705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.688683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c3ac18-c186-4356-afd7-6b76491a4ad7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.743881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd79ea6-e408-477b-92a6-d8cbf3ca520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.744546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd79ea6-e408-477b-92a6-d8cbf3ca520e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.744830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd79ea6-e408-477b-92a6-d8cbf3ca520e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.745108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd79ea6-e408-477b-92a6-d8cbf3ca520e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.745822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd79ea6-e408-477b-92a6-d8cbf3ca520e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.747520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd79ea6-e408-477b-92a6-d8cbf3ca520e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.757814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1206/2397] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:14 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:14.762173 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.772888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac440-468b-47e1-89a5-dd6583a313ea admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.777441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.778342 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.778666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.778928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] PATH_INFO: `/v3/projects/bdfa7de840384387ad50dcfbfecbf90b/users/ad2aea2c76b0476992e4ff2e9008666c/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.780851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfa7de840384387ad50dcfbfecbf90b, user_id=ad2aea2c76b0476992e4ff2e9008666c, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.783518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.793366 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1192/2398] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:14 2021] PUT /identity/v3/projects/bdfa7de840384387ad50dcfbfecbf90b/users/ad2aea2c76b0476992e4ff2e9008666c/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:14.803974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.806136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.806136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.830559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] MFA Rules not processed for user `ad2aea2c76b0476992e4ff2e9008666c`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:14.832436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:14.897874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1207/2399] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:14 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:14.908234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:14.909964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:14.965488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1845b7e-840d-4104-8dbd-11fce4c9e315 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:14.969251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:14.969899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:14.970183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:14.970459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:14.979415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:14.980849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:14.991152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1193/2400] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:14 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:15.032968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:15.034355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:15.046123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ee53-d1b9-415f-809d-87e6ead01e93 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:15.049822 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f12a8f-959c-4725-a809-9687c538645b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:15.050999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12a8f-959c-4725-a809-9687c538645b service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:15.051286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12a8f-959c-4725-a809-9687c538645b service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:15.051567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f12a8f-959c-4725-a809-9687c538645b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:15.105446 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f12a8f-959c-4725-a809-9687c538645b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:15.106924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f12a8f-959c-4725-a809-9687c538645b service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:15.116093 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1208/2401] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:15 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:19.744814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:19.807399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a894d6-b2e4-4b03-b9f3-28b526fa5465 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:19.811929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:19.812793 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:19.813079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:19.813353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] PATH_INFO: `/v3/users/b3ceb2f6fe7e41b99cd446ec28c9b4ef` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:19.814601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ceb2f6fe7e41b99cd446ec28c9b4ef)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:19.816484 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:20.046645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ceb2f6fe7e41b99cd446ec28c9b4ef'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.058219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ceb2f6fe7e41b99cd446ec28c9b4ef'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.116911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ceb2f6fe7e41b99cd446ec28c9b4ef'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.124441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ceb2f6fe7e41b99cd446ec28c9b4ef'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.125067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ceb2f6fe7e41b99cd446ec28c9b4ef'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.131603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1194/2402] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:19 2021] DELETE /identity/v3/users/b3ceb2f6fe7e41b99cd446ec28c9b4ef => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:20.136254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:20.136766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:20.136876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:20.153447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:20.154678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:20.210930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1209/2403] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:20.221075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:20.222465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:20.279014 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47390fdc-bfa3-495c-bef5-82261486a2eb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:20.282604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:20.283241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:20.283521 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:20.283795 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:20.292554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:20.293979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:20.303773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1195/2404] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:20.744137 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:20.745607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:20.757753 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286d83e-b6fa-411d-9475-cc39126bd8f3 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:20.762433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:20.763370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:20.763654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:20.764330 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] PATH_INFO: `/v3/projects/7b1a30355fef4fda83698ab169c6bc41` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:20.765357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1a30355fef4fda83698ab169c6bc41)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:20.767360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:20.876850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1a30355fef4fda83698ab169c6bc41', 'request_id': 'req-598c8345-8f12-4610-ab84-9bd2b21888c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.882725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1a30355fef4fda83698ab169c6bc41', 'request_id': 'req-598c8345-8f12-4610-ab84-9bd2b21888c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.950914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1a30355fef4fda83698ab169c6bc41', 'request_id': 'req-598c8345-8f12-4610-ab84-9bd2b21888c0'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.961399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] The token cache is being invalidate because project 7b1a30355fef4fda83698ab169c6bc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:20.961694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.962295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:20.963890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1210/2405] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:20 2021] DELETE /identity/v3/projects/7b1a30355fef4fda83698ab169c6bc41 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:20.967830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:20.977924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82caa3-55a8-4140-a84d-972a7806cf45 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:21.030850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:21.031716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:21.031995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:21.032268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] PATH_INFO: `/v3/users/ad2aea2c76b0476992e4ff2e9008666c` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:21.033452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad2aea2c76b0476992e4ff2e9008666c)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:21.035381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:21.243703 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad2aea2c76b0476992e4ff2e9008666c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:21.255445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad2aea2c76b0476992e4ff2e9008666c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:21.384942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad2aea2c76b0476992e4ff2e9008666c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:21.392115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad2aea2c76b0476992e4ff2e9008666c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:21.392742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bc6037d6-ee18-46be-8abe-8df9cec1a63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad2aea2c76b0476992e4ff2e9008666c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:21.399356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1196/2406] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:20 2021] DELETE /identity/v3/users/ad2aea2c76b0476992e4ff2e9008666c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:21.818106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:21.819552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:21.832448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598c8345-8f12-4610-ab84-9bd2b21888c0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:21.888240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:21.889091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:21.889368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:21.889637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] PATH_INFO: `/v3/projects/bdfa7de840384387ad50dcfbfecbf90b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:21.890819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfa7de840384387ad50dcfbfecbf90b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:21.892716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.005314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfa7de840384387ad50dcfbfecbf90b', 'request_id': 'req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:22.011200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfa7de840384387ad50dcfbfecbf90b', 'request_id': 'req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:22.067396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfa7de840384387ad50dcfbfecbf90b', 'request_id': 'req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:22.077661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] The token cache is being invalidate because project bdfa7de840384387ad50dcfbfecbf90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:22.077945 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:22.078568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-1a2ccfd2-99d0-4094-bdbd-0aa8700f1903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:22.080189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1211/2407] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:21 2021] DELETE /identity/v3/projects/bdfa7de840384387ad50dcfbfecbf90b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:22.085860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.086339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.086434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.104606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:22.105810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:22.163041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1197/2408] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:22.170549 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.170876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.171148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.189700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:22.190942 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:22.198937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1212/2409] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:22.203182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.212673 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed9168-9fe6-45de-91ed-87ac75070515 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.217308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.217955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.218236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.218509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.219258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:22.219565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.221139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.232991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1198/2410] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:19:22.237337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.247314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933eaed-f1ab-4e89-b899-43bff430558c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.251944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.252634 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.252917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.253192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.253912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.255934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.352391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1213/2411] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:22.356718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.368057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787466e-ef9b-40e8-b08d-58a3879fafac admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.422922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.423587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.423868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.424139 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.424816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.426871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.499820 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1199/2412] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:22.503905 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.514160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7154e-f9ba-4a83-921c-81e69faefd30 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.518847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.519511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.520312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.521317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.521317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.522911 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.533474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1214/2413] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:22.538187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.548507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca53dc-4966-451b-8afb-dcec06e7c31d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.553372 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f207228-1801-4721-b968-d496f4791f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.554033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f207228-1801-4721-b968-d496f4791f13 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.554321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f207228-1801-4721-b968-d496f4791f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.554636 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f207228-1801-4721-b968-d496f4791f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.555365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f207228-1801-4721-b968-d496f4791f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.557034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f207228-1801-4721-b968-d496f4791f13 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.567074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1200/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:22 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:22.571022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.580796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09398b0-d7fb-4ddc-803a-2db44da2882d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.586072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.586976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.587259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.587533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] PATH_INFO: `/v3/projects/373bd6c333474cc4937b4d6f0e7c6de0/users/4b80b03ea43243649115cc23a2d03532/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.602318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=373bd6c333474cc4937b4d6f0e7c6de0, user_id=4b80b03ea43243649115cc23a2d03532, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.605065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.683971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1215/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:22 2021] PUT /identity/v3/projects/373bd6c333474cc4937b4d6f0e7c6de0/users/4b80b03ea43243649115cc23a2d03532/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:22.694466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.694898 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.695251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.724153 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] MFA Rules not processed for user `4b80b03ea43243649115cc23a2d03532`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:22.725438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:22.793909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1201/2416] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:22.798184 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.873916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a902630-af2f-489a-81fd-c511f2bed875 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:22.879534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:22.880217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:22.880500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:22.880819 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:22.881519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:22.883519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:22.980792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1216/2417] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/projects => generated 389 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:22.985320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:22.996550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e8b46-260d-4334-88b8-83e73fdf35ef None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:23.055612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:23.056539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.056894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.057267 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.058063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:23.060251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:23.163947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1202/2418] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:22 2021] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:23.168164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:23.179698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1f8c4-2bfd-471f-ba66-35b58e609ffb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:23.184773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:23.185518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.185998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.186413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.187254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:23.188930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:23.205521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1217/2419] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:23.206615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:23.222917 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0532e7-23db-472f-a64b-cb2b0f601eea admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:23.223088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:23.224053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.224410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.224762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] PATH_INFO: `/v3/projects/17fe4138069a4a98a2f3604c8f114ff0/users/68b2ec5c353f476399f31a8079eaf92e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.241247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fe4138069a4a98a2f3604c8f114ff0, user_id=68b2ec5c353f476399f31a8079eaf92e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:23.244207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:23.330185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1203/2420] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:23 2021] PUT /identity/v3/projects/17fe4138069a4a98a2f3604c8f114ff0/users/68b2ec5c353f476399f31a8079eaf92e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:23.334141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:23.344503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb57279-ac66-4fae-993b-4f829f590d02 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:23.399554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6f08e-0607-4fc0-bc03-f88b054ac0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:23.400216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f08e-0607-4fc0-bc03-f88b054ac0fc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.400537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f08e-0607-4fc0-bc03-f88b054ac0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.401106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6f08e-0607-4fc0-bc03-f88b054ac0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.401818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f08e-0607-4fc0-bc03-f88b054ac0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:23.403453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6f08e-0607-4fc0-bc03-f88b054ac0fc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:23.416384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1218/2421] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:23.417587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:23.428320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f7570-e0ea-469b-ab2c-36fc9bfce1df admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:23.433387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:23.434313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.434621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.434903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] PATH_INFO: `/v3/projects/17fe4138069a4a98a2f3604c8f114ff0/users/68b2ec5c353f476399f31a8079eaf92e/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.436957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17fe4138069a4a98a2f3604c8f114ff0, user_id=68b2ec5c353f476399f31a8079eaf92e, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:23.439770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:23.451114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1204/2422] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:23 2021] PUT /identity/v3/projects/17fe4138069a4a98a2f3604c8f114ff0/users/68b2ec5c353f476399f31a8079eaf92e/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:23.462511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.462829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.463163 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.490488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] MFA Rules not processed for user `68b2ec5c353f476399f31a8079eaf92e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:23.491724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:23.559448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1219/2423] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:23 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:23.569390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:23.571165 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:23.633270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8d015-6a6e-4f5d-956a-3ba3570ae8d9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:23.636965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0726caf3-05e9-43fb-9d91-8be543269225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:23.637619 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726caf3-05e9-43fb-9d91-8be543269225 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:23.637899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726caf3-05e9-43fb-9d91-8be543269225 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:23.638179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726caf3-05e9-43fb-9d91-8be543269225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:23.647253 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726caf3-05e9-43fb-9d91-8be543269225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:23.648734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0726caf3-05e9-43fb-9d91-8be543269225 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:23.657973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1205/2424] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:23 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:23.940686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:24.005020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cbb15-d73e-4e55-9ae9-1e63b2269e41 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:24.009894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:24.010794 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:24.011077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:24.011349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] PATH_INFO: `/v3/users/4b80b03ea43243649115cc23a2d03532` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:24.012640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b80b03ea43243649115cc23a2d03532)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:24.014567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:24.198983 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b80b03ea43243649115cc23a2d03532'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:24.211623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b80b03ea43243649115cc23a2d03532'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:24.218167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b80b03ea43243649115cc23a2d03532'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:24.358868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b80b03ea43243649115cc23a2d03532'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:24.359481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b80b03ea43243649115cc23a2d03532'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:24.369917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1220/2425] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:23 2021] DELETE /identity/v3/users/4b80b03ea43243649115cc23a2d03532 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:24.371635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:24.372183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:24.372183 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:24.399969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:24.401298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:24.460912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1206/2426] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:24.471232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:24.472902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:24.530831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4e659-d3e4-43b0-a84f-dc498fbc1e9a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:24.534662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:24.535349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:24.535632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:24.535908 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:24.546898 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:24.548355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:24.558181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1221/2427] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:19:24.966201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:24.967657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:24.981321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6f2ed-256f-48aa-aa45-e51b42d94d25 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:24.986770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:24.987635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:24.987955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:24.988669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] PATH_INFO: `/v3/projects/373bd6c333474cc4937b4d6f0e7c6de0` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:24.989909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=373bd6c333474cc4937b4d6f0e7c6de0)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:24.991771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:25.101744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '373bd6c333474cc4937b4d6f0e7c6de0', 'request_id': 'req-0c377a24-5c56-4947-9e38-ebe468aae6df'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.107794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '373bd6c333474cc4937b4d6f0e7c6de0', 'request_id': 'req-0c377a24-5c56-4947-9e38-ebe468aae6df'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.189985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '373bd6c333474cc4937b4d6f0e7c6de0', 'request_id': 'req-0c377a24-5c56-4947-9e38-ebe468aae6df'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.201810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] The token cache is being invalidate because project 373bd6c333474cc4937b4d6f0e7c6de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:25.201810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.202067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.203425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1207/2428] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:24 2021] DELETE /identity/v3/projects/373bd6c333474cc4937b4d6f0e7c6de0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:25.207484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:25.217052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bf440-a9af-4edd-acaa-4610782d9c75 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:25.271852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:25.272727 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:25.273008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:25.273280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] PATH_INFO: `/v3/users/68b2ec5c353f476399f31a8079eaf92e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:25.274513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b2ec5c353f476399f31a8079eaf92e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:25.276450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:25.502779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b2ec5c353f476399f31a8079eaf92e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.514572 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b2ec5c353f476399f31a8079eaf92e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.521868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b2ec5c353f476399f31a8079eaf92e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.610645 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b2ec5c353f476399f31a8079eaf92e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.611301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-57bf61ab-bfa7-49cb-a962-43fcb1d6bd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b2ec5c353f476399f31a8079eaf92e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:25.618623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1222/2429] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:25 2021] DELETE /identity/v3/users/68b2ec5c353f476399f31a8079eaf92e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:19:26.024060 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.025588 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:26.040467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c377a24-5c56-4947-9e38-ebe468aae6df admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.097700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.098541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.098858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.099130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] PATH_INFO: `/v3/projects/17fe4138069a4a98a2f3604c8f114ff0` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.100397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=17fe4138069a4a98a2f3604c8f114ff0)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.102381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.219927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17fe4138069a4a98a2f3604c8f114ff0', 'request_id': 'req-e7290423-f3e5-4645-8243-4e4323774d2d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:26.226193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17fe4138069a4a98a2f3604c8f114ff0', 'request_id': 'req-e7290423-f3e5-4645-8243-4e4323774d2d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:26.288081 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17fe4138069a4a98a2f3604c8f114ff0', 'request_id': 'req-e7290423-f3e5-4645-8243-4e4323774d2d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:26.299539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] The token cache is being invalidate because project 17fe4138069a4a98a2f3604c8f114ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:26.299954 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:26.301116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e7290423-f3e5-4645-8243-4e4323774d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:26.303168 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1208/2430] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:26 2021] DELETE /identity/v3/projects/17fe4138069a4a98a2f3604c8f114ff0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:26.308540 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.309057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.309305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.328369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:26.329590 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:26.386879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1223/2431] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:26.400695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.401120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.401398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.419714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:26.420915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:26.430138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1209/2432] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:26.434559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.445674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae541e-7d2c-4a59-bd7d-2c4d21b14204 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.451161 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.451831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.452118 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.452399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.453134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:26.453442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.455122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.467334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1224/2433] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:19:26.472073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.481302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164afe0-22d7-4e40-ad1c-6f7b0b413b25 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.486287 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.486979 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.491514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.491514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.491514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.491514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.603986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1210/2434] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:26 2021] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:26.608078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.618876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff39752-9fde-4dea-ae1d-badf4abed890 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.672381 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.673062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.673369 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.673611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.674293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.677139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.781868 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1225/2435] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:26 2021] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:26.786444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.799393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f200c-531f-4563-821d-75a63b321003 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.806229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.807278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.807672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.808000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.808815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.810418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.821131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1211/2436] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:26 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:26.825058 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.835207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540ee49-f4c6-4df0-87f9-ee8502dab9ec admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.840177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cefaddb-39fe-4ff0-953a-c16e3e57dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.840919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefaddb-39fe-4ff0-953a-c16e3e57dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.841277 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefaddb-39fe-4ff0-953a-c16e3e57dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.841626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cefaddb-39fe-4ff0-953a-c16e3e57dc13 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.842474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefaddb-39fe-4ff0-953a-c16e3e57dc13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.844260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cefaddb-39fe-4ff0-953a-c16e3e57dc13 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.855305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1226/2437] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:26.859330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:26.870971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd5e31-3b2f-4666-9721-73227bf06b2b admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:26.875792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:26.876697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.877059 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.877339 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] PATH_INFO: `/v3/projects/99ccef3304164cb1bb03900d6274e03c/users/3f17a943899e4c2993f64dbe2957860d/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:26.891866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ccef3304164cb1bb03900d6274e03c, user_id=3f17a943899e4c2993f64dbe2957860d, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:26.895019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:26.964950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1212/2438] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:26 2021] PUT /identity/v3/projects/99ccef3304164cb1bb03900d6274e03c/users/3f17a943899e4c2993f64dbe2957860d/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:19:26.977824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:26.978115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:26.978394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.004587 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] MFA Rules not processed for user `3f17a943899e4c2993f64dbe2957860d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:27.005781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:27.068574 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1227/2439] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:26 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:27.073264 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.140698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b466e11-c928-4b00-9a41-d2817d7cd59e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.146158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.146873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.147147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.147414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.148114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.150019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.280034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1213/2440] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:27 2021] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:27.284228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.295363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16a396-a4a6-467e-a256-0fa464eba81d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.349454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.350152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.350407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.350715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.351418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.353380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.443007 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1228/2441] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:27 2021] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:27.447078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.458516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91bfce-7298-4d9c-911e-284f21e8f464 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.463324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.464067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.464402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.464683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.465410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.467034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.478130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1214/2442] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:27 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:27.482313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.493561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c9544-6baf-4ef4-a056-333f6a2e2834 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.498342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.499268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.499551 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.499825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] PATH_INFO: `/v3/projects/01a36fb903b542418ecabfb280babf50/users/a3a4e8de08dc4b679b92c012baf614b3/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.515257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a36fb903b542418ecabfb280babf50, user_id=a3a4e8de08dc4b679b92c012baf614b3, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.520076 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.602671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1229/2443] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:27 2021] PUT /identity/v3/projects/01a36fb903b542418ecabfb280babf50/users/a3a4e8de08dc4b679b92c012baf614b3/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:27.606696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.617269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e0148-508f-4e08-8a9c-ed5570d35dc3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.671952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.672632 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.672921 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.673257 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.674020 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.676434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.686282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1215/2444] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:27 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:27.690504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.691785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.693538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:27.701577 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02436d4d-d550-49d8-a6b9-ca7743d5f558 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.706227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f235ef-cacb-4ff8-97b6-d8e3a40b0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.708365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f235ef-cacb-4ff8-97b6-d8e3a40b0aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.708654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f235ef-cacb-4ff8-97b6-d8e3a40b0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.708960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f235ef-cacb-4ff8-97b6-d8e3a40b0aa1 admin admin] PATH_INFO: `/v3/projects/01a36fb903b542418ecabfb280babf50/users/a3a4e8de08dc4b679b92c012baf614b3/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.711046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f235ef-cacb-4ff8-97b6-d8e3a40b0aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a36fb903b542418ecabfb280babf50, user_id=a3a4e8de08dc4b679b92c012baf614b3, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.713748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f235ef-cacb-4ff8-97b6-d8e3a40b0aa1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.736103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1230/2445] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:27 2021] PUT /identity/v3/projects/01a36fb903b542418ecabfb280babf50/users/a3a4e8de08dc4b679b92c012baf614b3/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:27.738680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.739181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.739405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.755754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e7867-25f0-4aa8-8584-7a754f412733 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.767787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] MFA Rules not processed for user `a3a4e8de08dc4b679b92c012baf614b3`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:27.769321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:27.808849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.809478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.809765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.810042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.811829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:27.843483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1231/2446] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:27 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:27.853525 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:27.855070 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:27.884103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.885749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.896141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1216/2447] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:27 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:19:27.927238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2610e-c6af-44a6-a549-a217f7a4566b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:27.932720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890cca2-254a-4018-99cb-fc3ebe6f3f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:27.933808 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890cca2-254a-4018-99cb-fc3ebe6f3f5e service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:27.934173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890cca2-254a-4018-99cb-fc3ebe6f3f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:27.934775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890cca2-254a-4018-99cb-fc3ebe6f3f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:27.948396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890cca2-254a-4018-99cb-fc3ebe6f3f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:27.949938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890cca2-254a-4018-99cb-fc3ebe6f3f5e service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:27.987786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1232/2448] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:27 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:19:29.058367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:29.134987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefba0f-5a9e-49e9-bfaa-77b80593c8cc service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:29.141023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:29.141905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:29.142185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:29.142459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] PATH_INFO: `/v3/users/3f17a943899e4c2993f64dbe2957860d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:29.143730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f17a943899e4c2993f64dbe2957860d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:29.146154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:29.553993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f17a943899e4c2993f64dbe2957860d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:29.575721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f17a943899e4c2993f64dbe2957860d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:29.653350 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f17a943899e4c2993f64dbe2957860d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:29.660604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f17a943899e4c2993f64dbe2957860d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:29.661246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f17a943899e4c2993f64dbe2957860d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:29.667181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1217/2449] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:29 2021] DELETE /identity/v3/users/3f17a943899e4c2993f64dbe2957860d => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:29.671970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:29.672443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:29.672543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:29.689318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:29.690526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:29.749308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1233/2450] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:29.759539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:29.761043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:29.817633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0266605-445b-4d98-a87c-402901cc469a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:29.821656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:29.822310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:29.822598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:29.822887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:29.832625 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:29.834048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:29.843266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1218/2451] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:30.280293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:30.281810 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:30.294939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f28fa-9687-43c5-a73f-50cd105e72e9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:30.300972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:30.301164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:30.301671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:30.301955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] PATH_INFO: `/v3/projects/99ccef3304164cb1bb03900d6274e03c` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:30.303174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ccef3304164cb1bb03900d6274e03c)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:30.305104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:30.443495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ccef3304164cb1bb03900d6274e03c', 'request_id': 'req-3a82e2be-ca90-40df-9e13-d0869a693075'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.450684 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ccef3304164cb1bb03900d6274e03c', 'request_id': 'req-3a82e2be-ca90-40df-9e13-d0869a693075'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.518860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ccef3304164cb1bb03900d6274e03c', 'request_id': 'req-3a82e2be-ca90-40df-9e13-d0869a693075'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.541893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] The token cache is being invalidate because project 99ccef3304164cb1bb03900d6274e03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:30.542188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.542886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.544599 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1234/2452] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:30 2021] DELETE /identity/v3/projects/99ccef3304164cb1bb03900d6274e03c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:30.548587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:30.560113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb0fd2-ebe5-43a9-8c3a-b396470d64a2 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:30.629107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:30.630052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:30.630341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:30.630822 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] PATH_INFO: `/v3/users/a3a4e8de08dc4b679b92c012baf614b3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:30.632461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3a4e8de08dc4b679b92c012baf614b3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:30.635510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:30.824971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3a4e8de08dc4b679b92c012baf614b3'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.840530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3a4e8de08dc4b679b92c012baf614b3'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.922944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3a4e8de08dc4b679b92c012baf614b3'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.931920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3a4e8de08dc4b679b92c012baf614b3'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.932837 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-11354c48-9730-412a-b1d2-e19213ad4f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3a4e8de08dc4b679b92c012baf614b3'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:30.939623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1219/2453] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:30 2021] DELETE /identity/v3/users/a3a4e8de08dc4b679b92c012baf614b3 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:31.417185 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:31.418663 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:31.436309 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a82e2be-ca90-40df-9e13-d0869a693075 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:31.494455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:31.495475 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:31.495765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:31.496044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] PATH_INFO: `/v3/projects/01a36fb903b542418ecabfb280babf50` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:31.497237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a36fb903b542418ecabfb280babf50)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:31.499278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:31.632295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a36fb903b542418ecabfb280babf50', 'request_id': 'req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:31.638502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a36fb903b542418ecabfb280babf50', 'request_id': 'req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:31.773439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a36fb903b542418ecabfb280babf50', 'request_id': 'req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:31.785325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] The token cache is being invalidate because project 01a36fb903b542418ecabfb280babf50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:31.794141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:31.794141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7bdbf5e3-7f17-4c3a-88a0-798e9b7ac502 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:31.794141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1235/2454] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:31 2021] DELETE /identity/v3/projects/01a36fb903b542418ecabfb280babf50 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:31.794459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:31.794459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:31.794459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:31.813503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:31.814745 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:31.876260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1220/2455] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:31.884314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:31.884607 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:31.884888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:31.903009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:31.904214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:31.912695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1236/2456] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:31.916598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:31.926791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca44b7-ae35-4fd3-aa65-a2de57157976 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:31.931432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:31.932112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:31.932393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:31.932665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:31.933382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:31.933690 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:31.935309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:31.946390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1221/2457] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:19:31.950460 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:31.959519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db1ab8-9f37-496c-ad22-bb52ce746bf0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:31.964181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:31.964826 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:31.965114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:31.965392 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:31.966089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:31.968023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.094175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1237/2458] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:31 2021] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:32.098595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.108419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542ec82-4add-4d5d-a62b-9e3a788d3728 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.168324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.168911 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.169197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.169474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.170154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.172104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.316321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1222/2459] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:32 2021] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:32.320728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.330933 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb4848-6a22-4ac5-afe8-610bb21012e1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.336384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.337047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.338047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.338047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.338391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.340095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.351081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1238/2460] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:32.355550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.367137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c133aa-b19d-438d-afdf-3ae930ab8907 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.372446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564b28d-f901-4c83-8392-b8134e2a4f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.373138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b28d-f901-4c83-8392-b8134e2a4f4b admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.373424 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b28d-f901-4c83-8392-b8134e2a4f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.373855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564b28d-f901-4c83-8392-b8134e2a4f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.374633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b28d-f901-4c83-8392-b8134e2a4f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.376303 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564b28d-f901-4c83-8392-b8134e2a4f4b admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.387874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1223/2461] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:32 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:32.391854 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.401678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902822e-7304-4b8a-9f99-2193f1fae071 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.406271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.407181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.407463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.407737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] PATH_INFO: `/v3/projects/241aa3e44c7d40aeb60ea073cdd14145/users/05b49cc3bb114173a63598abc9760f83/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.422124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] RBAC: Authorizing `identity:create_grant(project_id=241aa3e44c7d40aeb60ea073cdd14145, user_id=05b49cc3bb114173a63598abc9760f83, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.424901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.495289 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1239/2462] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:32 2021] PUT /identity/v3/projects/241aa3e44c7d40aeb60ea073cdd14145/users/05b49cc3bb114173a63598abc9760f83/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:32.507009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.507304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.507582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.533960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] MFA Rules not processed for user `05b49cc3bb114173a63598abc9760f83`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:32.535697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:32.599646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1224/2463] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:32 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:19:32.604143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.664912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3731a4a-6759-4ee8-9815-24c2a1ff590f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.669492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.670142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.670425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.670732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.671411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.673362 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.771339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1240/2464] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:32 2021] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:32.775268 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.787022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a545634-8b48-4990-850f-cd5cf6ba671e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.848101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.848944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.849334 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.849730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.850529 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.852626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.956368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1225/2465] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:32 2021] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:32.960702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:32.970863 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0dbdd-b4bf-45fa-b0b7-82ce60ce163b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:32.976284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:32.976937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:32.977219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:32.977494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:32.978303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:32.979951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:32.990212 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1241/2466] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:32 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:32.994218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.004383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f39b59-52f1-4898-98c2-ca300b2ad7e4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.010439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294a441-0073-4ce4-b103-6d399b6ff011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.011123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a441-0073-4ce4-b103-6d399b6ff011 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.011405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a441-0073-4ce4-b103-6d399b6ff011 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.011682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294a441-0073-4ce4-b103-6d399b6ff011 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.012396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294a441-0073-4ce4-b103-6d399b6ff011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.014047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294a441-0073-4ce4-b103-6d399b6ff011 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.024299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1226/2467] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:19:33.028366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.039578 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ae08b-0f8e-42f7-b936-a503d01c99c4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.044395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.045282 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.045600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.045881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] PATH_INFO: `/v3/projects/87ba3bbcd0d74d0186ece5b2cdc8b071/users/f86b945160cd420d8cd164196d3f7bcf/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.060395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ba3bbcd0d74d0186ece5b2cdc8b071, user_id=f86b945160cd420d8cd164196d3f7bcf, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.063099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.133316 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1242/2468] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:33 2021] PUT /identity/v3/projects/87ba3bbcd0d74d0186ece5b2cdc8b071/users/f86b945160cd420d8cd164196d3f7bcf/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:33.143478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.143792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.144552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.171915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] MFA Rules not processed for user `f86b945160cd420d8cd164196d3f7bcf`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:33.173111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:33.233830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1227/2469] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:33 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:33.238245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.298062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b9058-6a73-4e1d-90d1-ebc05d8fccc4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.302718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.303411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.303689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.303960 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.304636 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.306528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.382507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1243/2470] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:33 2021] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:33.387357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.400690 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b98916-08ab-426c-bdb1-7e8446e5c03d None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.455391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.456068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.456351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.457180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.457863 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.459810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.561990 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1228/2471] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:33 2021] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:19:33.566507 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.576777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83365842-4ae2-4311-9dbd-8d3753535249 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.581428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.582811 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.583128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.583404 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.584123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.585718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.595971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1244/2472] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:33.599925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.609619 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84f957-02fe-472c-ab55-76a32ea36eb6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.614739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.615613 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.615899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.616178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] PATH_INFO: `/v3/projects/abfbc3fdfa6b4e639f844ff8fc88bac2/users/20b4606f3f3f410eb11aa2c1b5dba65f/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.633848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfbc3fdfa6b4e639f844ff8fc88bac2, user_id=20b4606f3f3f410eb11aa2c1b5dba65f, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.637215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.701442 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1229/2473] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:33 2021] PUT /identity/v3/projects/abfbc3fdfa6b4e639f844ff8fc88bac2/users/20b4606f3f3f410eb11aa2c1b5dba65f/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:33.705428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.715358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de03fe-7f9d-43cd-9535-27d3c30a666e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.769906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232d26e-8165-4752-91f3-925f38606c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.770568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232d26e-8165-4752-91f3-925f38606c8e admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.770877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232d26e-8165-4752-91f3-925f38606c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.771154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232d26e-8165-4752-91f3-925f38606c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.771869 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232d26e-8165-4752-91f3-925f38606c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.773447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232d26e-8165-4752-91f3-925f38606c8e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.783417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1245/2474] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:33 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:33.787626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.797986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119bea2-daab-444c-ae50-10edaa9cb5c0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:33.803392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:33.804270 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.804555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.804835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] PATH_INFO: `/v3/projects/abfbc3fdfa6b4e639f844ff8fc88bac2/users/20b4606f3f3f410eb11aa2c1b5dba65f/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.806814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abfbc3fdfa6b4e639f844ff8fc88bac2, user_id=20b4606f3f3f410eb11aa2c1b5dba65f, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:33.809441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:33.820244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1230/2475] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:33 2021] PUT /identity/v3/projects/abfbc3fdfa6b4e639f844ff8fc88bac2/users/20b4606f3f3f410eb11aa2c1b5dba65f/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:19:33.830110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:33.830423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:33.830748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:33.856879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] MFA Rules not processed for user `20b4606f3f3f410eb11aa2c1b5dba65f`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:33.858059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:33.933443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1246/2476] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:33 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:33.940197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:33.942728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:33.998965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5accc531-575c-436c-9d4b-4e68a7897374 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:34.002811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:34.004092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:34.004430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:34.004682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:34.061347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:34.062835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:34.071743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1231/2477] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:33 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:36.030395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:36.040737 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5d6c9-e704-4616-9db0-b163f21d4345 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:36.044311 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:36.044955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:36.045237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:36.045713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:36.102561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:36.104190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:36.115635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1247/2478] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:36 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:37.604897 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:37.613332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888d51f-281a-495f-a0f3-30a7c91ffa9d service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:37.617770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9929bba9-52c7-4f0c-9ea6-eb6876ff89ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:37.618400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929bba9-52c7-4f0c-9ea6-eb6876ff89ad service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:37.618716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929bba9-52c7-4f0c-9ea6-eb6876ff89ad service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:37.618992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9929bba9-52c7-4f0c-9ea6-eb6876ff89ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:37.627737 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929bba9-52c7-4f0c-9ea6-eb6876ff89ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:37.629152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9929bba9-52c7-4f0c-9ea6-eb6876ff89ad service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:37.639964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1232/2479] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:37 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:42.309092 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:42.368339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96f9c3-3630-4cf6-ab1c-d5b7a9e8b8ad service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:42.372850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:42.373758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:42.374008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:42.374281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] PATH_INFO: `/v3/users/05b49cc3bb114173a63598abc9760f83` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:42.375557 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b49cc3bb114173a63598abc9760f83)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:42.377473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:42.490731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b49cc3bb114173a63598abc9760f83'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:42.502353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b49cc3bb114173a63598abc9760f83'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:42.509088 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b49cc3bb114173a63598abc9760f83'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:42.551925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b49cc3bb114173a63598abc9760f83'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:42.553133 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b49cc3bb114173a63598abc9760f83'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:42.559237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1248/2480] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:42 2021] DELETE /identity/v3/users/05b49cc3bb114173a63598abc9760f83 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:42.563883 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:42.564382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:42.564500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:42.581526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:42.582786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:42.638539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1233/2481] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:42.648859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:42.650306 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:42.706006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d637b9-166c-40c1-86cb-6d6df0197c8a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:42.710140 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:42.710817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:42.711086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:42.711368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:42.725473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:42.726976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:42.736991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1249/2482] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:43.130967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:43.133716 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:43.144312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14b26-ca42-4197-89e1-817cd3518748 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:43.149658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:43.150517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:43.150892 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:43.151184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] PATH_INFO: `/v3/projects/241aa3e44c7d40aeb60ea073cdd14145` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:43.152425 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=241aa3e44c7d40aeb60ea073cdd14145)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:43.154327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:43.277794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241aa3e44c7d40aeb60ea073cdd14145', 'request_id': 'req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.284116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241aa3e44c7d40aeb60ea073cdd14145', 'request_id': 'req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.375032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241aa3e44c7d40aeb60ea073cdd14145', 'request_id': 'req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.386486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] The token cache is being invalidate because project 241aa3e44c7d40aeb60ea073cdd14145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:43.386807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.387444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.388985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1234/2483] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:43 2021] DELETE /identity/v3/projects/241aa3e44c7d40aeb60ea073cdd14145 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:43.392958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:43.402600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce942-8863-4140-a303-0a261342e40a service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:43.455842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:43.456722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:43.456982 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:43.457252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] PATH_INFO: `/v3/users/f86b945160cd420d8cd164196d3f7bcf` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:43.458432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86b945160cd420d8cd164196d3f7bcf)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:43.460371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:43.616741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86b945160cd420d8cd164196d3f7bcf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.627998 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86b945160cd420d8cd164196d3f7bcf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.635073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86b945160cd420d8cd164196d3f7bcf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.723397 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86b945160cd420d8cd164196d3f7bcf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.724496 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86b945160cd420d8cd164196d3f7bcf'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:43.730786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1250/2484] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:43 2021] DELETE /identity/v3/users/f86b945160cd420d8cd164196d3f7bcf => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:44.124310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:44.126260 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:44.139013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b25f70-8172-44cc-b7d5-ed9edb23f3ce admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:44.193505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:44.194357 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:44.194675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:44.194950 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] PATH_INFO: `/v3/projects/87ba3bbcd0d74d0186ece5b2cdc8b071` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:44.196108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ba3bbcd0d74d0186ece5b2cdc8b071)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:44.198003 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:44.303995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ba3bbcd0d74d0186ece5b2cdc8b071', 'request_id': 'req-357043ef-e407-4525-b912-3f3e9e4d989c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.309995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ba3bbcd0d74d0186ece5b2cdc8b071', 'request_id': 'req-357043ef-e407-4525-b912-3f3e9e4d989c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.372114 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ba3bbcd0d74d0186ece5b2cdc8b071', 'request_id': 'req-357043ef-e407-4525-b912-3f3e9e4d989c'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.382489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] The token cache is being invalidate because project 87ba3bbcd0d74d0186ece5b2cdc8b071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:44.382808 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.388022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.388022 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1235/2485] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:44 2021] DELETE /identity/v3/projects/87ba3bbcd0d74d0186ece5b2cdc8b071 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:44.388883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:44.390267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:44.403288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5941a-828f-42e3-8e50-8a7bf283c066 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:44.457373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:44.458364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:44.459229 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:44.459519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] PATH_INFO: `/v3/users/20b4606f3f3f410eb11aa2c1b5dba65f` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:44.460714 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b4606f3f3f410eb11aa2c1b5dba65f)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:44.462662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:44.602056 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b4606f3f3f410eb11aa2c1b5dba65f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.613428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b4606f3f3f410eb11aa2c1b5dba65f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.620235 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b4606f3f3f410eb11aa2c1b5dba65f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.694703 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b4606f3f3f410eb11aa2c1b5dba65f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.695249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-5680216a-cb4a-4e4e-9152-621b2162e1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b4606f3f3f410eb11aa2c1b5dba65f'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:44.701327 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1251/2486] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:44 2021] DELETE /identity/v3/users/20b4606f3f3f410eb11aa2c1b5dba65f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:45.128456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.129973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:45.143092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357043ef-e407-4525-b912-3f3e9e4d989c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.204354 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.205221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.205498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.205769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] PATH_INFO: `/v3/projects/abfbc3fdfa6b4e639f844ff8fc88bac2` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.206971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abfbc3fdfa6b4e639f844ff8fc88bac2)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.208887 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.331275 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abfbc3fdfa6b4e639f844ff8fc88bac2', 'request_id': 'req-81745f62-39fa-4267-8bfb-facf0e97f9f6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:45.337336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abfbc3fdfa6b4e639f844ff8fc88bac2', 'request_id': 'req-81745f62-39fa-4267-8bfb-facf0e97f9f6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:45.400530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abfbc3fdfa6b4e639f844ff8fc88bac2', 'request_id': 'req-81745f62-39fa-4267-8bfb-facf0e97f9f6'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:45.411132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] The token cache is being invalidate because project abfbc3fdfa6b4e639f844ff8fc88bac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:45.411939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:45.412567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-81745f62-39fa-4267-8bfb-facf0e97f9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:45.414100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1236/2487] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:45 2021] DELETE /identity/v3/projects/abfbc3fdfa6b4e639f844ff8fc88bac2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:45.419720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.420166 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.420284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.438937 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:45.440134 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:45.496548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1252/2488] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:45.505412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.505704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.505985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.524335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:45.530037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:45.533330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1237/2489] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:45.538186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.547665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44867f4c-017d-48d9-b29b-50ff1ef41dd0 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.552886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.553532 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.553809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.554078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.554825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:19:45.555129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.556739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.567787 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1253/2490] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:19:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:19:45.571959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.581024 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7479c4ce-8775-4c1a-8dd4-b611f01b20a3 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.586481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.587104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.587390 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.587666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.588352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.590247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.670180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1238/2491] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:19:45 2021] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:45.674323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.684245 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d9caa-665d-4b83-951d-3b5d4c902cdd admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.739495 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.740188 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.740471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.740747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.741695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.743644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.817620 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1254/2492] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:19:45 2021] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:19:45.821652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.831782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c60dbe-3504-45fa-a073-fc31b163370a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.836890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.837486 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.837768 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.838042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.838790 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.842734 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.850951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1239/2493] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:45.854718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.864503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cd663-8981-4c03-b40b-36d943bbb479 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.869410 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea6476-535c-43ca-8f55-70eb1f120c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.870057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea6476-535c-43ca-8f55-70eb1f120c2c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.870340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea6476-535c-43ca-8f55-70eb1f120c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.870648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea6476-535c-43ca-8f55-70eb1f120c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.871360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea6476-535c-43ca-8f55-70eb1f120c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.872941 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea6476-535c-43ca-8f55-70eb1f120c2c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.882500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1255/2494] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:19:45 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:19:45.886291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:45.896416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f185ec5-0308-410f-816d-e652a7592a8d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:45.900985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45881453-481f-4524-964b-d283459a1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:45.901846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45881453-481f-4524-964b-d283459a1813 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:45.902125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45881453-481f-4524-964b-d283459a1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:45.902396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45881453-481f-4524-964b-d283459a1813 admin admin] PATH_INFO: `/v3/projects/d0ee5137dfba46c7935179f0a5595181/users/d949757f1e7b46c4a853de242e15889d/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:45.916664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45881453-481f-4524-964b-d283459a1813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ee5137dfba46c7935179f0a5595181, user_id=d949757f1e7b46c4a853de242e15889d, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:45.919329 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45881453-481f-4524-964b-d283459a1813 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:45.997221 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1240/2495] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:19:45 2021] PUT /identity/v3/projects/d0ee5137dfba46c7935179f0a5595181/users/d949757f1e7b46c4a853de242e15889d/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:46.007660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:46.007951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:46.008228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:46.034102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] MFA Rules not processed for user `d949757f1e7b46c4a853de242e15889d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:46.035365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:46.095312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1256/2496] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:46 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:46.105463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45881453-481f-4524-964b-d283459a1813 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:46.107214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-45881453-481f-4524-964b-d283459a1813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:46.164564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45881453-481f-4524-964b-d283459a1813 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:46.168576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24960d90-ff12-4894-ab16-0812110d2250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:46.169222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24960d90-ff12-4894-ab16-0812110d2250 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:46.169513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24960d90-ff12-4894-ab16-0812110d2250 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:46.169774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24960d90-ff12-4894-ab16-0812110d2250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:46.178074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24960d90-ff12-4894-ab16-0812110d2250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:46.179520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24960d90-ff12-4894-ab16-0812110d2250 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:46.188180 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1241/2497] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:46 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:46.213997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:46.274438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02afea82-c173-40b4-af4e-08347daaf64f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:46.279081 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:46.279938 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:46.280215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:46.280481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] PATH_INFO: `/v3/users/d949757f1e7b46c4a853de242e15889d` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:46.281796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d949757f1e7b46c4a853de242e15889d)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:46.283901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:46.496926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd949757f1e7b46c4a853de242e15889d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:46.509805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd949757f1e7b46c4a853de242e15889d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:46.516731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd949757f1e7b46c4a853de242e15889d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:46.597472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd949757f1e7b46c4a853de242e15889d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:46.598106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd949757f1e7b46c4a853de242e15889d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:46.604357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1257/2498] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:46 2021] DELETE /identity/v3/users/d949757f1e7b46c4a853de242e15889d => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:46.610362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:46.610684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:46.610963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:46.628809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:46.630597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:46.687730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1242/2499] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:46.697487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:46.698984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:46.762704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10635d-2899-4244-85ee-bf6eb738bc86 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:46.766350 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:46.767032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:46.767313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:46.767586 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:46.776484 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:46.778080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:46.788335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1258/2500] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:47.175513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:47.177805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:47.190035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3367ac-f0e1-4d4c-90a8-47ee00a3a5c3 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:47.194860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:47.196479 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:47.196860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:47.197033 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] PATH_INFO: `/v3/projects/d0ee5137dfba46c7935179f0a5595181` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:47.198223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ee5137dfba46c7935179f0a5595181)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:47.201182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:47.403650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ee5137dfba46c7935179f0a5595181', 'request_id': 'req-d7aa5778-cc66-4910-b60c-bbc2f3444182'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:47.409857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ee5137dfba46c7935179f0a5595181', 'request_id': 'req-d7aa5778-cc66-4910-b60c-bbc2f3444182'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:47.483205 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ee5137dfba46c7935179f0a5595181', 'request_id': 'req-d7aa5778-cc66-4910-b60c-bbc2f3444182'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:47.494056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] The token cache is being invalidate because project d0ee5137dfba46c7935179f0a5595181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:47.494378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:47.495320 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d7aa5778-cc66-4910-b60c-bbc2f3444182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:47.496858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1243/2501] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:47 2021] DELETE /identity/v3/projects/d0ee5137dfba46c7935179f0a5595181 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:52.240175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:52.241840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:52.255258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027d658-1ae3-45da-9e82-03cae956a798 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:52.309270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:52.310127 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:52.310406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:52.310706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] PATH_INFO: `/v3/users/bdda75f6d0f34bb2b198d8b3a8912a24` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:52.311986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdda75f6d0f34bb2b198d8b3a8912a24)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:52.313919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:52.482772 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdda75f6d0f34bb2b198d8b3a8912a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:52.495233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdda75f6d0f34bb2b198d8b3a8912a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:52.502106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdda75f6d0f34bb2b198d8b3a8912a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:52.566205 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdda75f6d0f34bb2b198d8b3a8912a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:52.566840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdda75f6d0f34bb2b198d8b3a8912a24'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:52.573805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1259/2502] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:19:52 2021] DELETE /identity/v3/users/bdda75f6d0f34bb2b198d8b3a8912a24 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:19:52.578402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:52.578929 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:52.579072 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:52.596697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:19:52.597904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:52.655244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1244/2503] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:19:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:19:52.666865 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:52.668248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:52.724564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31ab05-ba2a-4465-89f9-7a5eda797a22 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:52.728385 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924b5c-9d39-46fe-a2a0-2723cd7403bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:52.729046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924b5c-9d39-46fe-a2a0-2723cd7403bd service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:52.729334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924b5c-9d39-46fe-a2a0-2723cd7403bd service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:52.729613 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924b5c-9d39-46fe-a2a0-2723cd7403bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:52.738951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924b5c-9d39-46fe-a2a0-2723cd7403bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:52.740748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924b5c-9d39-46fe-a2a0-2723cd7403bd service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:52.750414 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1260/2504] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:19:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:19:53.150352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:19:53.151859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:19:53.164438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443866c-a188-46fa-a47c-00ac0ff6bc93 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:19:53.169514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:19:53.170419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:19:53.170749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:19:53.171032 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] PATH_INFO: `/v3/projects/b52bb41e88f54ec2abf8213026a61089` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:19:53.172235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52bb41e88f54ec2abf8213026a61089)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:19:53.174158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:19:53.285705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52bb41e88f54ec2abf8213026a61089', 'request_id': 'req-0091e06a-090d-43ad-a2b1-e2981fd73dff'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:53.292279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52bb41e88f54ec2abf8213026a61089', 'request_id': 'req-0091e06a-090d-43ad-a2b1-e2981fd73dff'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:53.342915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52bb41e88f54ec2abf8213026a61089', 'request_id': 'req-0091e06a-090d-43ad-a2b1-e2981fd73dff'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:53.353706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] The token cache is being invalidate because project b52bb41e88f54ec2abf8213026a61089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:19:53.353996 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:53.354650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-0091e06a-090d-43ad-a2b1-e2981fd73dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:19:53.356211 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1245/2505] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:19:53 2021] DELETE /identity/v3/projects/b52bb41e88f54ec2abf8213026a61089 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:20:04.995336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:04.996427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:04.996427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:05.013326 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] MFA Rules not processed for user `af5ad45d471648a487e5c95cb63163e8`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:20:05.014518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:05.068396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1261/2506] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:20:04 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:20:25.614477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:25.615215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:25.615327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:25.632549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] MFA Rules not processed for user `490a8522f743475187844c39a4ba6dea`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:20:25.633731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:25.687464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1246/2507] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:20:25 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:20:30.875708 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:20:30.877128 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:30.931777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826826b-11e2-4a5b-858a-4199a2ba8a0f None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:20:30.935422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:20:30.936061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:30.936344 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:30.936621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:30.938365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:31.007476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:20:31.008912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:20:31.019981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1262/2508] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:20:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:20:36.786171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:20:36.787744 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:36.799784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a77047-7339-4ef0-9393-95323596e5ca None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:20:36.803330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:20:36.803967 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:36.804248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:36.804523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:36.806186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:36.819890 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:20:36.821312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:20:36.842931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1247/2509] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:20:36 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:20:39.541545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:20:39.543063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:39.558814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef8718-04a7-42ef-b657-399401e2f221 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:20:39.565592 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:20:39.566253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:39.566537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:39.566861 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:39.569492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:39.581196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:20:39.582823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:20:39.592879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1263/2510] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:20:39 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:20:46.367045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:20:46.368496 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:46.382037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a26833-5e93-4b39-bbcb-1458afd9f476 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:20:46.387782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:20:46.388418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:46.388698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:46.388973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:46.390759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:46.401482 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:20:46.403121 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a516627-376a-4434-b05c-c931c73a62a1 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:20:46.412549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1248/2511] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:20:46 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:20:52.664642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:20:52.674538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3b90-b57c-4bed-b7ea-dbb3b50006ea service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:20:52.678195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:20:52.678862 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:20:52.679142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:20:52.679411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:20:52.681191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:20:52.690628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:20:52.692237 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:20:52.700252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1264/2512] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:20:52 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:21:16.023134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:16.023639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:16.023732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:16.041455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:21:16.042824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:16.096517 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1249/2513] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:21:16 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:21:16.275806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:16.278280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:16.349048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180187de-4665-4679-9e36-7339149e9f72 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:16.354774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:16.355367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:16.355651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:16.355931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:16.365141 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:16.366900 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:16.375992 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1265/2514] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:21:16 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:21:18.209409 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:18.223110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56cfe60-3734-45b0-9691-98b621d9a055 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:18.230648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:18.230648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:18.230648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:18.230648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:18.233530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:18.248936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:18.251273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:18.265778 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1250/2515] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:21:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:21:33.242366 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:33.243804 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:33.311049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f3525-1a28-4121-8c54-99ba3e989a6c service swift] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:33.316052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:33.316716 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:33.317001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:33.317283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:33.319040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:33.330763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:33.332354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4ff45-99e7-4b9e-b6bd-243d4f2e98b6 service placement] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:33.342292 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1266/2516] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:21:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:21:33.444172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:33.447324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:33.460234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a3352-36a8-4730-810f-a749161dddd4 service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:33.465333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:33.466023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:33.466299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:33.466599 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:33.468322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:33.480256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:33.481874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:33.492102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1251/2517] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:21:33 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:21:35.662907 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3312c6-0127-45ae-bc55-21d1ed3a9ce5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:35.663379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3312c6-0127-45ae-bc55-21d1ed3a9ce5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:35.663379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3312c6-0127-45ae-bc55-21d1ed3a9ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:35.680834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0b3312c6-0127-45ae-bc55-21d1ed3a9ce5 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:21:35.682561 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0b3312c6-0127-45ae-bc55-21d1ed3a9ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:35.689791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1267/2518] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:21:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:21:35.702317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:35.713251 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078115-7c7d-4292-98d4-556fcf753c54 service placement] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:35.718217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:35.718885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:35.719693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:35.719973 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:35.728188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:35.729730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:35.738622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1252/2519] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:21:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:21:53.841268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:53.841841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:53.841951 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:53.861208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:21:53.862711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:53.869976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1268/2520] 10.222.0.16 () {58 vars in 968 bytes} [Tue Aug 10 05:21:53 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:21:53.882549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:53.893474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa01c74-3e83-4973-9e65-dc870df009c8 service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:53.898936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782981d2-e07c-4c75-bc09-f2d7aa54bd9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:53.899582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782981d2-e07c-4c75-bc09-f2d7aa54bd9b service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:53.899866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782981d2-e07c-4c75-bc09-f2d7aa54bd9b service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:53.900134 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782981d2-e07c-4c75-bc09-f2d7aa54bd9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:53.909164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782981d2-e07c-4c75-bc09-f2d7aa54bd9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:53.910775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782981d2-e07c-4c75-bc09-f2d7aa54bd9b service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:53.919104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1253/2521] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:21:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:21:56.695809 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:21:56.709765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c2714-ccf0-46e5-9e42-d793f54ec9d1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:21:56.716110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:21:56.716884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:21:56.717272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:21:56.717649 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:21:56.719616 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:21:56.732278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:21:56.733999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69da20a-c455-484b-999c-f6b25ce5f66a service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:21:56.746796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1269/2522] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:21:56 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:00.246631 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4cb47-403c-43c3-8581-21f59a6d342e None None] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:00.247182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4cb47-403c-43c3-8581-21f59a6d342e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:00.247182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4cb47-403c-43c3-8581-21f59a6d342e None None] PATH_INFO: `/` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:00.249027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1254/2523] 10.222.0.16 () {54 vars in 921 bytes} [Tue Aug 10 05:22:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 10 05:22:00.256346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:00.256836 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:00.261157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:00.276367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] MFA Rules not processed for user `4d558aa3bcd84a2f8407c2e566da213b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:00.277576 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:00.300252 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1270/2524] 10.222.0.16 () {58 vars in 1019 bytes} [Tue Aug 10 05:22:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:00.316720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4cb47-403c-43c3-8581-21f59a6d342e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:00.328027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4cb47-403c-43c3-8581-21f59a6d342e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:00.331684 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:00.332328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:00.332612 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:00.332886 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:00.340016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:00.341487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:00.349544 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1255/2525] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:00 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:03.228986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:03.238376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e56d1-dbe3-4662-bfaf-9b2b6e789ec1 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:03.242016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:03.242686 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:03.242971 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:03.243247 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:03.245053 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:03.305012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:03.306452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:03.317449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1271/2526] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:06.696426 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:06.697855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:06.713637 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c5a89-ba0b-401d-9022-77da99de8897 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:06.718181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:06.719093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:06.719374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:06.719645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] PATH_INFO: `/v3/users/490a8522f743475187844c39a4ba6dea` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:06.720818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=490a8522f743475187844c39a4ba6dea)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:06.722757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:06.876807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490a8522f743475187844c39a4ba6dea'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:06.887961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490a8522f743475187844c39a4ba6dea'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:06.942137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490a8522f743475187844c39a4ba6dea'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:06.949101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490a8522f743475187844c39a4ba6dea'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:06.949765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9b815e29-fc07-437a-b2b0-ba4e65d30a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490a8522f743475187844c39a4ba6dea'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:06.955759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1256/2527] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:22:06 2021] DELETE /identity/v3/users/490a8522f743475187844c39a4ba6dea => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:07.174626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.185761 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32da9c9-33ab-4a10-a1e0-a2762c83ef2e service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.243676 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.244547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.244824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.245179 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] PATH_INFO: `/v3/projects/72a3bb25c2374aa8a148b26d66d2eda1` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.246378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a3bb25c2374aa8a148b26d66d2eda1)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.248296 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:07.342406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a3bb25c2374aa8a148b26d66d2eda1', 'request_id': 'req-a3866768-b965-4a45-aecd-0dfe29d85337'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:07.349090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a3bb25c2374aa8a148b26d66d2eda1', 'request_id': 'req-a3866768-b965-4a45-aecd-0dfe29d85337'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:07.415732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a3bb25c2374aa8a148b26d66d2eda1', 'request_id': 'req-a3866768-b965-4a45-aecd-0dfe29d85337'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:07.426498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] The token cache is being invalidate because project 72a3bb25c2374aa8a148b26d66d2eda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:22:07.426821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:07.427633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a3866768-b965-4a45-aecd-0dfe29d85337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:07.429347 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1272/2528] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:22:07 2021] DELETE /identity/v3/projects/72a3bb25c2374aa8a148b26d66d2eda1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:07.435146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.435446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.435728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.453573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:07.454874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:07.512385 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1257/2529] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:07.521228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.521695 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.522072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.544433 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:07.545644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:07.554493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1273/2530] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:07.558934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.570076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee511542-2952-42c6-b9d3-1ea3f6171d72 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.574763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.575418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.575702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.575978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.576698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:22:07.577004 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.579138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:07.592908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1258/2531] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:22:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:22:07.597981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.607305 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea759b18-13d3-4f24-9379-17250cc09e45 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.612215 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.612860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.613139 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.613412 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.614096 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.616034 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:07.691341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1274/2532] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:22:07 2021] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:07.695382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.705781 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef050b-ebda-4b02-a78f-8444720c2cc6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.759787 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.760453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.760733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.761007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.761681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.763622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:07.833627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1259/2533] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:22:07 2021] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:07.837492 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.848319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803887a-5b92-4d51-8f27-7ef4304ea40b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.852944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.853595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.853877 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.854149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.854915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.856538 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:07.867181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1275/2534] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:07.870991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.880824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7993f-9c00-42c7-a67e-d449fd5515a6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.885527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4ed12-b6a9-496b-adde-559709fef04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.886179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ed12-b6a9-496b-adde-559709fef04e admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.886466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ed12-b6a9-496b-adde-559709fef04e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.886782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4ed12-b6a9-496b-adde-559709fef04e admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.887507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ed12-b6a9-496b-adde-559709fef04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.889093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4ed12-b6a9-496b-adde-559709fef04e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:07.899116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1260/2535] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:07.902924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:07.913434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4b2324-c32b-4e09-91aa-12ca8f1675a1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:07.918174 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:07.919085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:07.919370 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:07.919647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] PATH_INFO: `/v3/projects/9c1e88b565f34674a368e054f0a19cd8/users/7021089fd78c4c70b303877e71bc6215/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:07.933581 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1e88b565f34674a368e054f0a19cd8, user_id=7021089fd78c4c70b303877e71bc6215, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:07.936270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:08.012504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1276/2536] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:07 2021] PUT /identity/v3/projects/9c1e88b565f34674a368e054f0a19cd8/users/7021089fd78c4c70b303877e71bc6215/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:08.017658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ce5f-64c1-4b7d-b96d-e9ad69ec40c1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:08.017947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ce5f-64c1-4b7d-b96d-e9ad69ec40c1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:08.018223 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d4ce5f-64c1-4b7d-b96d-e9ad69ec40c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:08.036570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e0d4ce5f-64c1-4b7d-b96d-e9ad69ec40c1 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:08.037855 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e0d4ce5f-64c1-4b7d-b96d-e9ad69ec40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:08.097549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1261/2537] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:08.107100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:08.108800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:08.163774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7328c4-70ce-4c2d-9828-aa9dde20090e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:08.167447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c547fb1-4dde-4583-981b-c5b7902dcbbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:08.168084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547fb1-4dde-4583-981b-c5b7902dcbbf service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:08.168368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547fb1-4dde-4583-981b-c5b7902dcbbf service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:08.168644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c547fb1-4dde-4583-981b-c5b7902dcbbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:08.177974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547fb1-4dde-4583-981b-c5b7902dcbbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:08.179431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c547fb1-4dde-4583-981b-c5b7902dcbbf service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:08.188712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1277/2538] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:09.448733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:09.449256 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:09.449378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:09.475099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] MFA Rules not processed for user `7021089fd78c4c70b303877e71bc6215`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:09.476300 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:09.540353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1262/2539] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:09.552400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:09.552931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:09.552931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:09.570067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] MFA Rules not processed for user `7021089fd78c4c70b303877e71bc6215`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:09.571379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:09.579272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1278/2540] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:09 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:09.590434 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:09.591928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:09.672508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9727-5ea1-47d3-9e10-06f311f87370 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:09.681446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:09.682107 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:09.682396 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:09.682712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:09.691103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:09.692663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:09.701408 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1263/2541] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:09 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:09.913467 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:09.923505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7303b-4f85-43b8-8c55-96e3adc86b85 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:09.927040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:09.927782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:09.928021 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:09.928298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:09.930037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:09.940293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:09.941789 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30fa0f4-8c74-449b-8589-d2bc301a03b6 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:09.949765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1279/2542] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:09 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:14.269172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:14.270639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:14.292664 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa972ec-aea6-4c31-9644-70e4ad73218b service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:14.298285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:14.298984 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:14.299307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:14.299597 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:14.304988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:14.317575 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:14.319258 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:14.330169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1264/2543] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:32.999365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:32.999894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:33.000012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:33.019600 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] MFA Rules not processed for user `7021089fd78c4c70b303877e71bc6215`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:33.021360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:33.028341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1280/2544] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:32 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:33.267293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:33.268699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:33.280545 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5bcf0-40d3-463e-9a33-5e60ee37617e service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:33.284262 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:33.284931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:33.285213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:33.285509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:33.287804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:33.297576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:33.299021 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:33.307527 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1265/2545] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:33 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:37.056745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:37.066428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a213e-b58c-4237-aeed-90ec0da9883e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:37.070718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:37.076101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:37.076101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:37.076101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:37.076101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:37.089334 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:37.090816 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:37.103348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1281/2546] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:22:40.804695 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:40.806340 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:40.823874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d861b-5f51-496a-b5ca-d267cb1633d9 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:40.828526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:40.829467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:40.829915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:40.830188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] PATH_INFO: `/v3/users/af5ad45d471648a487e5c95cb63163e8` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:40.831481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5ad45d471648a487e5c95cb63163e8)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:40.834571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:40.989586 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5ad45d471648a487e5c95cb63163e8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.001978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5ad45d471648a487e5c95cb63163e8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.066476 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5ad45d471648a487e5c95cb63163e8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.073853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5ad45d471648a487e5c95cb63163e8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.074528 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d0269b94-94e2-41a7-86d2-86694572e33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5ad45d471648a487e5c95cb63163e8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.080387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1266/2547] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:22:40 2021] DELETE /identity/v3/users/af5ad45d471648a487e5c95cb63163e8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:41.298219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:41.308238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700ca3c-9bb5-4a22-a0fc-ea035b2b9543 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:41.366758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:41.367622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:41.367903 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:41.368177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] PATH_INFO: `/v3/projects/1bebe35ab6ed44b49537caff8aaa8562` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:41.369603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bebe35ab6ed44b49537caff8aaa8562)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:41.371552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:41.467132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bebe35ab6ed44b49537caff8aaa8562', 'request_id': 'req-64279032-39a2-4266-a56c-002a9e6f9833'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.474038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bebe35ab6ed44b49537caff8aaa8562', 'request_id': 'req-64279032-39a2-4266-a56c-002a9e6f9833'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.546043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bebe35ab6ed44b49537caff8aaa8562', 'request_id': 'req-64279032-39a2-4266-a56c-002a9e6f9833'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.556455 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] The token cache is being invalidate because project 1bebe35ab6ed44b49537caff8aaa8562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:22:41.556742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.557356 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-64279032-39a2-4266-a56c-002a9e6f9833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:41.558915 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1282/2548] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:22:41 2021] DELETE /identity/v3/projects/1bebe35ab6ed44b49537caff8aaa8562 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:41.564577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:41.564869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:41.569661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:41.584448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:41.585662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:41.641818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1267/2549] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:41.650444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:41.650777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:41.651059 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:41.668943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:41.670135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:41.677901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1283/2550] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:41.681860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:41.691333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f08dc-0f3b-4e30-88a5-f7de3042ed97 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:41.696761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:41.697445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:41.697724 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:41.697994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:41.698775 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:22:41.699085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:41.700697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:41.712561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1268/2551] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:22:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:22:41.716476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:41.725680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bade7-238e-4921-8d59-59808472f761 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:41.730471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:41.731154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:41.731438 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:41.731712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:41.732406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:41.734336 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:41.834115 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1284/2552] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:22:41 2021] POST /identity/v3/projects => generated 405 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:41.838444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:41.848593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b088627-2ea6-4c94-bcf7-9faa257f4f7f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:41.902874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:41.903541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:41.903824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:41.904100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:41.904794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:41.906714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:41.993420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1269/2553] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:22:41 2021] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:41.997457 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:42.008244 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a34a0-1832-420c-9694-15db71660e0a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:42.012844 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:42.013493 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:42.013774 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:42.014046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:42.017038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:42.017038 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:42.025889 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1285/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:42.029704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:42.040459 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939d8c7-5733-4372-ba1b-8b3031e11ae0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:42.045374 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0313c-facb-4b4e-b63c-0588bfbb6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:42.046043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0313c-facb-4b4e-b63c-0588bfbb6dfc admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:42.046324 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0313c-facb-4b4e-b63c-0588bfbb6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:42.046621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0313c-facb-4b4e-b63c-0588bfbb6dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:42.047345 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0313c-facb-4b4e-b63c-0588bfbb6dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:42.049000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c0313c-facb-4b4e-b63c-0588bfbb6dfc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:42.059906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1270/2555] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:42.063782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:42.074355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c325f45-f9a2-4ffb-ba75-ab14fdf342af admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:42.080114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:42.080928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:42.081217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:42.081497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] PATH_INFO: `/v3/projects/cd6ed0bff30e4e928a848518d2ef113a/users/a8d437ca3c3b4bd693916246e207c9f9/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:42.098044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6ed0bff30e4e928a848518d2ef113a, user_id=a8d437ca3c3b4bd693916246e207c9f9, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:42.100770 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:42.176647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1286/2556] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:42 2021] PUT /identity/v3/projects/cd6ed0bff30e4e928a848518d2ef113a/users/a8d437ca3c3b4bd693916246e207c9f9/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:42.181770 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fcf2b-9c67-41b6-aa88-1e8b9308fe3a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:42.182062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fcf2b-9c67-41b6-aa88-1e8b9308fe3a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:42.182344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76fcf2b-9c67-41b6-aa88-1e8b9308fe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:42.200364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-c76fcf2b-9c67-41b6-aa88-1e8b9308fe3a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:42.201573 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c76fcf2b-9c67-41b6-aa88-1e8b9308fe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:42.257823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1271/2557] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:42.267497 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:42.269165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:42.325888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235be97-2c25-4e3f-908e-65c5a68c46ac admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:42.329564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:42.330203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:42.330483 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:42.330783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:42.339548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:42.340972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:42.350505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1287/2558] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:43.711102 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618d843-225c-473c-bed3-16abc6065219 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:43.711732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618d843-225c-473c-bed3-16abc6065219 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:43.711732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618d843-225c-473c-bed3-16abc6065219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:43.741101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6618d843-225c-473c-bed3-16abc6065219 None None] MFA Rules not processed for user `a8d437ca3c3b4bd693916246e207c9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:43.742322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6618d843-225c-473c-bed3-16abc6065219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:43.806013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1272/2559] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:43 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:43.810349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:43.820564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a6234-d806-4ef3-baf7-90794e7518c5 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:43.825301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:43.826035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:43.826487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:43.826851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:43.827604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:43.829594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:43.943555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1288/2560] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:22:43 2021] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:22:43.947537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618d843-225c-473c-bed3-16abc6065219 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:43.959017 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618d843-225c-473c-bed3-16abc6065219 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:44.015089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:44.015846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:44.016132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:44.016412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:44.017113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:44.019156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:44.094090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1273/2561] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:22:43 2021] POST /identity/v3/users => generated 309 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:44.095339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:44.113364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee25bd-6327-4307-80ba-24c8fd628dfa admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:44.118805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:44.119505 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:44.119894 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:44.120177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:44.120914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:44.122533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:44.134086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1289/2562] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:44 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:44.138239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:44.151813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa97b7-6643-4ffd-8df1-5fde9433aa6c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:44.159869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:44.160882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:44.161238 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:44.161604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] PATH_INFO: `/v3/projects/adec13824e1b432fbde4fefc2369d72b/users/91f48ba95bb94550ad59780cfcd29191/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:44.178473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=adec13824e1b432fbde4fefc2369d72b, user_id=91f48ba95bb94550ad59780cfcd29191, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:44.181948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:44.250252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1274/2563] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:44 2021] PUT /identity/v3/projects/adec13824e1b432fbde4fefc2369d72b/users/91f48ba95bb94550ad59780cfcd29191/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:44.254784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:44.264591 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15406a-95e2-46e9-b323-b10fd114626c admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:44.317887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a76dfc-5261-4ea9-a2b6-2e9adbe47b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:44.318545 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76dfc-5261-4ea9-a2b6-2e9adbe47b08 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:44.318858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76dfc-5261-4ea9-a2b6-2e9adbe47b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:44.319136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a76dfc-5261-4ea9-a2b6-2e9adbe47b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:44.319847 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76dfc-5261-4ea9-a2b6-2e9adbe47b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:44.321437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a76dfc-5261-4ea9-a2b6-2e9adbe47b08 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:44.330866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1290/2564] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:44 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:44.335185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:44.345382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fd7cf-dc24-4570-a4ed-ede2632f7fbd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:44.350013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:44.350964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:44.351269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:44.351546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] PATH_INFO: `/v3/projects/adec13824e1b432fbde4fefc2369d72b/users/91f48ba95bb94550ad59780cfcd29191/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:44.353507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adec13824e1b432fbde4fefc2369d72b, user_id=91f48ba95bb94550ad59780cfcd29191, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:44.356176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:44.367601 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1275/2565] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:44 2021] PUT /identity/v3/projects/adec13824e1b432fbde4fefc2369d72b/users/91f48ba95bb94550ad59780cfcd29191/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:22:45.643769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65965c-a11a-456b-a237-7a281e76c79c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:45.644317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65965c-a11a-456b-a237-7a281e76c79c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:45.644622 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65965c-a11a-456b-a237-7a281e76c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:45.673584 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4d65965c-a11a-456b-a237-7a281e76c79c None None] MFA Rules not processed for user `91f48ba95bb94550ad59780cfcd29191`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:45.674927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4d65965c-a11a-456b-a237-7a281e76c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:45.745208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1291/2566] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:45 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:46.959978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:46.960803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:46.961180 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:46.961701 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:46.979383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] MFA Rules not processed for user `7021089fd78c4c70b303877e71bc6215`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:46.984924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:47.027261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81079350-9776-4a1c-94c8-86f6d04b1695 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:47.032206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:47.033075 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:47.033356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:47.033630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] PATH_INFO: `/v3/users/a8d437ca3c3b4bd693916246e207c9f9` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:47.034985 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d437ca3c3b4bd693916246e207c9f9)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:47.035502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1292/2567] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:46 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:22:47.037031 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:47.329452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d437ca3c3b4bd693916246e207c9f9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.340721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d437ca3c3b4bd693916246e207c9f9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.414845 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d437ca3c3b4bd693916246e207c9f9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.421964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d437ca3c3b4bd693916246e207c9f9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.427676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d437ca3c3b4bd693916246e207c9f9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.429623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1276/2568] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:22:46 2021] DELETE /identity/v3/users/a8d437ca3c3b4bd693916246e207c9f9 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:47.685895 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:47.696909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc4225-5961-401e-89a9-2d84bf5f6496 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:47.768272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:47.769189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:47.769471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:47.769741 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] PATH_INFO: `/v3/projects/cd6ed0bff30e4e928a848518d2ef113a` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:47.770997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6ed0bff30e4e928a848518d2ef113a)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:47.772952 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:47.883191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6ed0bff30e4e928a848518d2ef113a', 'request_id': 'req-c292ddbb-09b2-4e5f-9745-8a03b1829147'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.889057 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6ed0bff30e4e928a848518d2ef113a', 'request_id': 'req-c292ddbb-09b2-4e5f-9745-8a03b1829147'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.959646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6ed0bff30e4e928a848518d2ef113a', 'request_id': 'req-c292ddbb-09b2-4e5f-9745-8a03b1829147'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.970594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] The token cache is being invalidate because project cd6ed0bff30e4e928a848518d2ef113a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:22:47.971176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.971491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:47.973067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1293/2569] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:22:47 2021] DELETE /identity/v3/projects/cd6ed0bff30e4e928a848518d2ef113a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:47.977933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:47.979413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:47.993150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660f4d8-7c93-4638-b938-9f9fdbbf54a6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:48.050970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:48.051871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:48.052156 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:48.052428 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] PATH_INFO: `/v3/users/91f48ba95bb94550ad59780cfcd29191` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:48.053627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] RBAC: Authorizing `identity:delete_user(user_id=91f48ba95bb94550ad59780cfcd29191)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:48.055591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:48.205595 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91f48ba95bb94550ad59780cfcd29191'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.217305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91f48ba95bb94550ad59780cfcd29191'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.306992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91f48ba95bb94550ad59780cfcd29191'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.314440 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91f48ba95bb94550ad59780cfcd29191'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.315175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a65c2a-b94e-41a4-b4ef-19793028c57f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91f48ba95bb94550ad59780cfcd29191'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.321600 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1277/2570] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:22:47 2021] DELETE /identity/v3/users/91f48ba95bb94550ad59780cfcd29191 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:48.537806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:48.539402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:48.553338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292ddbb-09b2-4e5f-9745-8a03b1829147 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:48.616049 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:48.617067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:48.617353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:48.617657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] PATH_INFO: `/v3/projects/adec13824e1b432fbde4fefc2369d72b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:48.618880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adec13824e1b432fbde4fefc2369d72b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:48.620947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:48.711667 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adec13824e1b432fbde4fefc2369d72b', 'request_id': 'req-70537f12-992e-4353-b9a9-a3beb8815155'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.717661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adec13824e1b432fbde4fefc2369d72b', 'request_id': 'req-70537f12-992e-4353-b9a9-a3beb8815155'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.801322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adec13824e1b432fbde4fefc2369d72b', 'request_id': 'req-70537f12-992e-4353-b9a9-a3beb8815155'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.810498 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] The token cache is being invalidate because project adec13824e1b432fbde4fefc2369d72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:22:48.810828 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.811481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-70537f12-992e-4353-b9a9-a3beb8815155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:48.813017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1294/2571] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:22:48 2021] DELETE /identity/v3/projects/adec13824e1b432fbde4fefc2369d72b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:22:48.819250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:48.819644 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:48.819976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:48.837460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:48.838683 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:48.897885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1278/2572] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:48.905850 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:48.906198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:48.906485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:48.924718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:48.925912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:48.934451 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1295/2573] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:48.938918 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:48.949766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333a82ac-6027-4139-befa-d97975ab5005 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:48.954451 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:48.955129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:48.955415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:48.955689 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:48.956437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:22:48.956741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:48.958563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:48.970157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1279/2574] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:22:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:22:48.974325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:48.983745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d0ae3-72b8-466e-8892-19f50ce213cf None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:48.989462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:48.995693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:48.995693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:48.995693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:48.995693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:48.995693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.078130 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1296/2575] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:22:48 2021] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:49.082159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.091866 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ee280-4832-465b-a491-59a265e3b4bb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.144932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.145589 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.145867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.146138 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.146850 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.148773 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.251411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1280/2576] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:22:49 2021] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:49.255511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.266598 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ba38e-e11e-4497-a9a0-77efe093e8a6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.271395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.272126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.272400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.272671 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.273393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.275022 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.286647 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1297/2577] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:49.291213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.300915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668367d-5e1b-42ef-a966-cc192f78aa22 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.306181 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f476f-f469-464d-98b3-96c2c5c1a209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.306858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f476f-f469-464d-98b3-96c2c5c1a209 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.317265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f476f-f469-464d-98b3-96c2c5c1a209 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.317265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f476f-f469-464d-98b3-96c2c5c1a209 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.317265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f476f-f469-464d-98b3-96c2c5c1a209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.317265 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f476f-f469-464d-98b3-96c2c5c1a209 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.319103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1281/2578] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:49.323274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.333037 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11b60a-c826-4f38-aa2d-ddd854c6c705 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.337724 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.338632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.338923 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.339207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] PATH_INFO: `/v3/projects/0730a0aa14814edeb60ac3283030f68b/users/6132d33afb194993895d4928e1636ed8/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.353926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0730a0aa14814edeb60ac3283030f68b, user_id=6132d33afb194993895d4928e1636ed8, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.356655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.462681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1298/2579] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:49 2021] PUT /identity/v3/projects/0730a0aa14814edeb60ac3283030f68b/users/6132d33afb194993895d4928e1636ed8/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:49.474791 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81552-f0fa-4311-859a-641768b33645 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.475082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81552-f0fa-4311-859a-641768b33645 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.475359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df81552-f0fa-4311-859a-641768b33645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.502243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3df81552-f0fa-4311-859a-641768b33645 None None] MFA Rules not processed for user `6132d33afb194993895d4928e1636ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:49.503430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3df81552-f0fa-4311-859a-641768b33645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:49.570729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1282/2580] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:49 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:49.575222 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.639170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16a434-148d-413f-a2fd-b9e580d297fb admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.643813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.647251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.647251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.647251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.647251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.648111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.775117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1299/2581] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:22:49 2021] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:49.776539 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81552-f0fa-4311-859a-641768b33645 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.787572 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df81552-f0fa-4311-859a-641768b33645 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.849037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.849717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.854804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.854804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.854804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.854804 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.940735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1283/2582] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:22:49 2021] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:49.944491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.954916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f2abe-52d9-4b38-9e60-667b61034243 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.960499 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.961220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.961506 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.961784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:49.962541 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:49.964275 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:49.976050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1300/2583] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:49.980227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:49.990997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2547996-ef35-49df-a7e4-e72370a863cb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:49.996313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:49.997364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:49.997659 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:49.997938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] PATH_INFO: `/v3/projects/7bd3ae8424b64c2bbcac5b73ea7ef7b7/users/182b7be061c64d1faeeb0fe8ac5cc60d/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:50.012658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd3ae8424b64c2bbcac5b73ea7ef7b7, user_id=182b7be061c64d1faeeb0fe8ac5cc60d, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:50.015368 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:50.083405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1284/2584] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:49 2021] PUT /identity/v3/projects/7bd3ae8424b64c2bbcac5b73ea7ef7b7/users/182b7be061c64d1faeeb0fe8ac5cc60d/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:50.087526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:50.097418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559ac15-eb9c-4945-8d06-95db8a127d76 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:50.169013 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c9f98-f613-434b-86d7-807ba3d71245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:50.175218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9f98-f613-434b-86d7-807ba3d71245 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:50.175218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9f98-f613-434b-86d7-807ba3d71245 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:50.175218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c9f98-f613-434b-86d7-807ba3d71245 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:50.175218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c9f98-f613-434b-86d7-807ba3d71245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:50.175218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c9f98-f613-434b-86d7-807ba3d71245 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:50.185988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1301/2585] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:50 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:50.189926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:50.204187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e81b1f-e5fb-4b2c-88e3-60084a19087d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:50.210207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:50.211882 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:50.212176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:50.212453 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] PATH_INFO: `/v3/projects/7bd3ae8424b64c2bbcac5b73ea7ef7b7/users/182b7be061c64d1faeeb0fe8ac5cc60d/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:50.214605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd3ae8424b64c2bbcac5b73ea7ef7b7, user_id=182b7be061c64d1faeeb0fe8ac5cc60d, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:50.217555 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:50.230646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1285/2586] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:50 2021] PUT /identity/v3/projects/7bd3ae8424b64c2bbcac5b73ea7ef7b7/users/182b7be061c64d1faeeb0fe8ac5cc60d/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:22:50.241583 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:50.241884 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:50.242168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:50.271192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] MFA Rules not processed for user `182b7be061c64d1faeeb0fe8ac5cc60d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:50.272535 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:50.344041 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1302/2587] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:50 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:50.358800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:50.358800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:50.422086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816e55-699d-4e79-979b-1e236388d1b9 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:50.426276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:50.427045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:50.427332 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:50.427972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:50.438214 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:50.440393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:50.449568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1286/2588] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:50 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:50.697857 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:50.707192 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa7a74-a220-42d5-b17d-9d1b6d3e2ac4 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:50.711153 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35e8bb-d692-4dca-b348-ccfaf04d13c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:50.711783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e8bb-d692-4dca-b348-ccfaf04d13c9 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:50.712062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e8bb-d692-4dca-b348-ccfaf04d13c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:50.712332 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e8bb-d692-4dca-b348-ccfaf04d13c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:50.766415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35e8bb-d692-4dca-b348-ccfaf04d13c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:50.768110 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae35e8bb-d692-4dca-b348-ccfaf04d13c9 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:50.777798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1303/2589] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:50 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:22:56.930432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:56.992763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3c3d2-4ca7-444b-b4fe-bdd0194a9b85 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:56.997379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:56.998248 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:56.998537 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:56.998889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] PATH_INFO: `/v3/users/6132d33afb194993895d4928e1636ed8` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:57.000068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6132d33afb194993895d4928e1636ed8)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:57.001982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:57.153938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6132d33afb194993895d4928e1636ed8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:57.165140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6132d33afb194993895d4928e1636ed8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:57.232322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6132d33afb194993895d4928e1636ed8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:57.240444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6132d33afb194993895d4928e1636ed8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:57.241073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6132d33afb194993895d4928e1636ed8'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:57.246854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1287/2590] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:22:56 2021] DELETE /identity/v3/users/6132d33afb194993895d4928e1636ed8 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:22:57.251331 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:57.251792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:57.251909 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:57.268398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:57.269588 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:57.325291 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1304/2591] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:57.335352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:57.336739 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:57.392859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207e3c2-4017-48db-a232-9b585fb962a2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:57.396470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:57.397112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:57.397393 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:57.397668 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:57.406438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:57.407931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:57.417556 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1288/2592] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:22:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:22:58.073640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:58.075368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:58.089632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe9462-b07d-4abb-8dfb-85d8c7e6f0ac None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:58.094486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:58.095436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:58.095713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:58.095987 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] PATH_INFO: `/v3/projects/0730a0aa14814edeb60ac3283030f68b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:58.097160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0730a0aa14814edeb60ac3283030f68b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:58.099217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:58.209482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0730a0aa14814edeb60ac3283030f68b', 'request_id': 'req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.215767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0730a0aa14814edeb60ac3283030f68b', 'request_id': 'req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.311906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0730a0aa14814edeb60ac3283030f68b', 'request_id': 'req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.323431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] The token cache is being invalidate because project 0730a0aa14814edeb60ac3283030f68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:22:58.323431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.324065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.325665 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1305/2593] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:22:58 2021] DELETE /identity/v3/projects/0730a0aa14814edeb60ac3283030f68b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:58.329621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:58.339639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e477a0c0-e025-4c29-adaa-26207a067b4f service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:58.394088 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:58.394995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:58.395278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:58.395553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] PATH_INFO: `/v3/users/182b7be061c64d1faeeb0fe8ac5cc60d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:58.396736 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182b7be061c64d1faeeb0fe8ac5cc60d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:58.398811 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:58.577305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182b7be061c64d1faeeb0fe8ac5cc60d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.589441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182b7be061c64d1faeeb0fe8ac5cc60d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.660844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182b7be061c64d1faeeb0fe8ac5cc60d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.667760 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182b7be061c64d1faeeb0fe8ac5cc60d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.668392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-da09fe97-ada1-40a2-89f7-d1fc2a2ca835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182b7be061c64d1faeeb0fe8ac5cc60d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:58.674083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1289/2594] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:22:58 2021] DELETE /identity/v3/users/182b7be061c64d1faeeb0fe8ac5cc60d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:59.078670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.081560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:59.104611 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d04860-e6aa-4d6c-a8df-66a83c94aa7d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.162271 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.163167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.163450 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.163725 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] PATH_INFO: `/v3/projects/7bd3ae8424b64c2bbcac5b73ea7ef7b7` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.164906 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd3ae8424b64c2bbcac5b73ea7ef7b7)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.166821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:59.265534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd3ae8424b64c2bbcac5b73ea7ef7b7', 'request_id': 'req-58e0f97f-bddd-4859-97af-6c3a5237f5a2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:59.272912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd3ae8424b64c2bbcac5b73ea7ef7b7', 'request_id': 'req-58e0f97f-bddd-4859-97af-6c3a5237f5a2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:59.358517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd3ae8424b64c2bbcac5b73ea7ef7b7', 'request_id': 'req-58e0f97f-bddd-4859-97af-6c3a5237f5a2'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:59.369939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] The token cache is being invalidate because project 7bd3ae8424b64c2bbcac5b73ea7ef7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:22:59.370234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:59.371124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58e0f97f-bddd-4859-97af-6c3a5237f5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:22:59.372769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1306/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:22:59 2021] DELETE /identity/v3/projects/7bd3ae8424b64c2bbcac5b73ea7ef7b7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:22:59.378419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.378907 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.379016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.397298 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:59.398494 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:59.455184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1290/2596] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:22:59.463214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.463504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.463801 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.482395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:22:59.483674 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:22:59.492091 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1307/2597] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:22:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:22:59.496193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.506080 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a067fea-3d67-4c23-8bfb-ebcdca2d95cd None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.510671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.511365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.511648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.511922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.512645 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:22:59.512958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.514543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:59.526792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1291/2598] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:22:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:22:59.531250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.540349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518fb88-343f-4a42-9d1d-fd5e15f1a09b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.545191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.545873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.546156 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.546432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.547164 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.549073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:59.668420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1308/2599] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:22:59 2021] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:22:59.672725 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.682974 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfbc542-2ad3-4712-a2ee-1b8cdba8316a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.737678 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.738353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.738721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.739025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.739905 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.741741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:59.836727 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1292/2600] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:22:59 2021] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:22:59.838485 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.848891 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a799ba-38ea-48f5-a582-c94626a18279 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.860339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.860339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.860339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.860339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.861298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.861298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:59.869145 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1309/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:59.873071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.888485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34f2bc-1389-4153-a308-21b8e9e92255 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.888628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf2108-8e37-4dca-bdde-d71abd76a950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.889284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2108-8e37-4dca-bdde-d71abd76a950 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.889565 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2108-8e37-4dca-bdde-d71abd76a950 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.889840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf2108-8e37-4dca-bdde-d71abd76a950 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.890553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf2108-8e37-4dca-bdde-d71abd76a950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.892194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf2108-8e37-4dca-bdde-d71abd76a950 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:22:59.902041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1293/2602] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:22:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:22:59.906083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:22:59.915955 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586b121-2850-415d-bf9f-697dfe2d7511 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:22:59.920589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:22:59.921448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:22:59.921730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:22:59.922001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] PATH_INFO: `/v3/projects/3cec71b6cf9846ff9befd1fd4d8128cd/users/2c788754fc0243169395cb35e690dad1/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:22:59.936973 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cec71b6cf9846ff9befd1fd4d8128cd, user_id=2c788754fc0243169395cb35e690dad1, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:22:59.939648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:00.002064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1310/2603] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:22:59 2021] PUT /identity/v3/projects/3cec71b6cf9846ff9befd1fd4d8128cd/users/2c788754fc0243169395cb35e690dad1/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:00.013655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:00.013993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:00.014271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:00.040052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] MFA Rules not processed for user `2c788754fc0243169395cb35e690dad1`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:00.041358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:00.104006 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1294/2604] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:00 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:00.115472 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:00.117255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:00.171069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9834493-d7ab-4cf5-bc7e-2787803184f9 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:00.174698 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497e302-e2c4-44a3-b727-2fbce31eeea7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:00.175333 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e302-e2c4-44a3-b727-2fbce31eeea7 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:00.175610 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e302-e2c4-44a3-b727-2fbce31eeea7 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:00.175882 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497e302-e2c4-44a3-b727-2fbce31eeea7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:00.184681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497e302-e2c4-44a3-b727-2fbce31eeea7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:00.186225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497e302-e2c4-44a3-b727-2fbce31eeea7 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:00.195807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1311/2605] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:00 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:00.215067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:00.276657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d0d9dd-2dc0-4de4-8c0d-cc6bbc3294b3 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:00.281377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:00.282284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:00.282569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:00.282904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] PATH_INFO: `/v3/users/2c788754fc0243169395cb35e690dad1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:00.284093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c788754fc0243169395cb35e690dad1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:00.286650 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:00.497035 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c788754fc0243169395cb35e690dad1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:00.508445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c788754fc0243169395cb35e690dad1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:00.581186 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c788754fc0243169395cb35e690dad1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:00.588254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c788754fc0243169395cb35e690dad1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:00.588910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c788754fc0243169395cb35e690dad1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:00.594942 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1295/2606] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:23:00 2021] DELETE /identity/v3/users/2c788754fc0243169395cb35e690dad1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:00.599791 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:00.600283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:00.600390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:00.617963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:00.619203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:00.675376 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1312/2607] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:00.685829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:00.687241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:00.744318 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f879f4d-941e-4311-965c-182f7093cef2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:00.748182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d701c00-c121-4644-ab78-1baa5b7abe64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:00.748794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d701c00-c121-4644-ab78-1baa5b7abe64 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:00.749131 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d701c00-c121-4644-ab78-1baa5b7abe64 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:00.749411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d701c00-c121-4644-ab78-1baa5b7abe64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:00.758344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d701c00-c121-4644-ab78-1baa5b7abe64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:00.759813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d701c00-c121-4644-ab78-1baa5b7abe64 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:00.769304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1296/2608] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:01.194653 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:01.196071 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:01.208779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff4346-9e70-4fed-8b70-f1317dd02c1b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:01.213771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:01.214632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.214919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.215200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] PATH_INFO: `/v3/projects/3cec71b6cf9846ff9befd1fd4d8128cd` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.216402 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cec71b6cf9846ff9befd1fd4d8128cd)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:01.218452 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:01.346879 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cec71b6cf9846ff9befd1fd4d8128cd', 'request_id': 'req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:01.352873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cec71b6cf9846ff9befd1fd4d8128cd', 'request_id': 'req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:01.431285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cec71b6cf9846ff9befd1fd4d8128cd', 'request_id': 'req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:01.444068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] The token cache is being invalidate because project 3cec71b6cf9846ff9befd1fd4d8128cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:23:01.444358 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:01.445009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-4ee758e8-3563-4ea9-ab01-c00ec3f3cbd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:01.446654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1313/2609] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:23:01 2021] DELETE /identity/v3/projects/3cec71b6cf9846ff9befd1fd4d8128cd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:01.452263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.452564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.452831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.471330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:01.472524 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:01.534242 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1297/2610] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:01.542196 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.542491 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.542796 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.562518 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:01.564002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:01.572709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1314/2611] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:23:01.577142 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:01.587058 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3feaa8-3038-4893-bcb6-cf6af4f5cb8a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:01.591731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:01.592397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.592660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.592931 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.593661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:23:01.593995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:01.595614 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:01.611377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1298/2612] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:23:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:23:01.615253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:01.624644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0f87c-37bc-456e-9a7e-4526067eeac7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:01.630527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:01.631249 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.632146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.632417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.633231 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:01.635294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:01.758928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1315/2613] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:23:01 2021] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:23:01.763263 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:01.773284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb054640-456b-42ce-9f4e-beedab785b47 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:01.829093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:01.829846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.830163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.830465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.831273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:01.833111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:01.921295 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1299/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:23:01 2021] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:23:01.922570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:01.933580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e069be7-f224-4f66-a373-66710e944c2a admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:01.938323 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:01.939014 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.939644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.939644 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.940657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:01.942324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:01.953691 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1316/2615] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:01.957779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:01.967824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642caf3-fc90-4082-baab-d568b7888092 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:01.972446 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0c8d-999d-42e9-aca7-3f6e746e67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:01.973628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0c8d-999d-42e9-aca7-3f6e746e67a5 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:01.973910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0c8d-999d-42e9-aca7-3f6e746e67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:01.974188 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0c8d-999d-42e9-aca7-3f6e746e67a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:01.974939 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0c8d-999d-42e9-aca7-3f6e746e67a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:01.976526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0c8d-999d-42e9-aca7-3f6e746e67a5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:01.986606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1300/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:01.991515 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:02.001617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca9902-ab31-4923-9f88-45d992e1e168 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:02.006380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:02.007297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:02.007585 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:02.007864 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] PATH_INFO: `/v3/projects/4ee86919b6ef4407aef3e35d7bbcf398/users/0f9e1f85eab740ecadfde950b4b1a6f7/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:02.022154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee86919b6ef4407aef3e35d7bbcf398, user_id=0f9e1f85eab740ecadfde950b4b1a6f7, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:02.024842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:02.129440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1317/2617] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:23:01 2021] PUT /identity/v3/projects/4ee86919b6ef4407aef3e35d7bbcf398/users/0f9e1f85eab740ecadfde950b4b1a6f7/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:02.139680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47252369-2442-434e-9f73-85d1d4b620e8 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:02.139932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47252369-2442-434e-9f73-85d1d4b620e8 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:02.140212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47252369-2442-434e-9f73-85d1d4b620e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:02.166785 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-47252369-2442-434e-9f73-85d1d4b620e8 None None] MFA Rules not processed for user `0f9e1f85eab740ecadfde950b4b1a6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:02.167994 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-47252369-2442-434e-9f73-85d1d4b620e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:02.229085 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1301/2618] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:02 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:02.240474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:02.242171 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:02.321738 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfbee50-84b9-450a-90a6-36d7cc52e8e1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:02.325427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:02.326072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:02.326357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:02.326664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:02.335544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:02.336981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:02.345666 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1318/2619] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:02 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:11.899070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f558c-efb4-4595-a854-ee0789dfbcfb None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:11.899619 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f558c-efb4-4595-a854-ee0789dfbcfb None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:11.899619 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f558c-efb4-4595-a854-ee0789dfbcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:11.917735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-eb3f558c-efb4-4595-a854-ee0789dfbcfb None None] MFA Rules not processed for user `7021089fd78c4c70b303877e71bc6215`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:11.918983 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-eb3f558c-efb4-4595-a854-ee0789dfbcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:11.978402 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1302/2620] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:11 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:21.545064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:21.606494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1f820-0526-4308-88aa-b8777df2003f service glance] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:21.611295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:21.612148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:21.612430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:21.612700 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] PATH_INFO: `/v3/users/0f9e1f85eab740ecadfde950b4b1a6f7` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:21.613887 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f9e1f85eab740ecadfde950b4b1a6f7)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:21.615817 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:21.731343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f9e1f85eab740ecadfde950b4b1a6f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:21.743419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f9e1f85eab740ecadfde950b4b1a6f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:21.750430 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f9e1f85eab740ecadfde950b4b1a6f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:21.797502 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f9e1f85eab740ecadfde950b4b1a6f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:21.798208 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f9e1f85eab740ecadfde950b4b1a6f7'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:21.804473 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1319/2621] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:23:21 2021] DELETE /identity/v3/users/0f9e1f85eab740ecadfde950b4b1a6f7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:21.813269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:21.813799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:21.813903 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:21.831175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:21.832924 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:21.888604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1303/2622] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:21.898919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:21.900278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:21.953751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344fcf6-e0e9-4133-8343-19c883e3c748 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:21.957986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f7cfb-0db2-457e-a792-33470255e8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:21.958641 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7cfb-0db2-457e-a792-33470255e8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:21.958920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7cfb-0db2-457e-a792-33470255e8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:21.959193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f7cfb-0db2-457e-a792-33470255e8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:21.967831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7cfb-0db2-457e-a792-33470255e8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:21.969256 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f7cfb-0db2-457e-a792-33470255e8f0 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:21.978294 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1320/2623] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:22.341831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:22.343299 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:22.355452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e05fa2-63f4-44a9-b8cd-b325fe8d5ba5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:22.360259 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:22.361384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:22.361661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:22.361935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] PATH_INFO: `/v3/projects/4ee86919b6ef4407aef3e35d7bbcf398` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:22.363143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee86919b6ef4407aef3e35d7bbcf398)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:22.365540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:22.511228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee86919b6ef4407aef3e35d7bbcf398', 'request_id': 'req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:22.517250 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee86919b6ef4407aef3e35d7bbcf398', 'request_id': 'req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:22.585936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee86919b6ef4407aef3e35d7bbcf398', 'request_id': 'req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:22.596554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] The token cache is being invalidate because project 4ee86919b6ef4407aef3e35d7bbcf398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:23:22.596848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:22.597490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-3daa06b6-cfa7-4bdc-8b62-bf71b8777eae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:22.599417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1304/2624] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:23:22 2021] DELETE /identity/v3/projects/4ee86919b6ef4407aef3e35d7bbcf398 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:22.605421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:22.612520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:22.612520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:22.624195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:22.625407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:22.683342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1321/2625] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:22.692926 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:22.693150 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:22.693430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:22.711505 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:22.712698 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:22.720710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1305/2626] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:22.725425 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:22.735219 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd42926-3c9a-4b4b-b5bf-1a0a930a0600 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:22.741170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:22.741830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:22.742269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:22.742547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:22.743298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:23:22.743604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:22.745255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:22.756805 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1322/2627] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:23:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:23:22.761172 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:22.770285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151a17c-11b8-462c-b3f6-370b07ab12e7 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:22.775008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:22.775660 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:22.775963 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:22.776239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:22.776933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:22.778889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:22.871824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1306/2628] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:23:22 2021] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:23:22.873706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:22.883901 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff131cfa-3c9f-486f-8a63-a51593c69bf0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:22.954744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:22.958398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:22.958398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:22.958398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:22.958398 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:22.959064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:23.061003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1323/2629] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:23:22 2021] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:23:23.065037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:23.075464 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e07d-d9d1-4870-aa21-4dda4201c89a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:23.080112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:23.084944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:23.084944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:23.084944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:23.084944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:23.084944 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:23.095658 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1307/2630] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:23.100878 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:23.110339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013e8b-9d8e-4002-9475-a9102d1cf3e4 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:23.115274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f180d5-3463-4418-a16d-1bd166bcebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:23.115924 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f180d5-3463-4418-a16d-1bd166bcebcc admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:23.116203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f180d5-3463-4418-a16d-1bd166bcebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:23.116474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f180d5-3463-4418-a16d-1bd166bcebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:23.117183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f180d5-3463-4418-a16d-1bd166bcebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:23.118799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f180d5-3463-4418-a16d-1bd166bcebcc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:23.128465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1324/2631] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:23 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:23.132530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:23.142353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1468546-d43f-4510-9b5c-775e9ab84e64 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:23.147653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:23.148569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:23.148859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:23.149179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] PATH_INFO: `/v3/projects/9878474d1482482daf32645bd6cf6c48/users/c686b1bd54314a5abed858123b050a0e/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:23.164384 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9878474d1482482daf32645bd6cf6c48, user_id=c686b1bd54314a5abed858123b050a0e, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:23.167092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:23.259753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1308/2632] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:23:23 2021] PUT /identity/v3/projects/9878474d1482482daf32645bd6cf6c48/users/c686b1bd54314a5abed858123b050a0e/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:23.270337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:23.270705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:23.270984 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:23.297783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] MFA Rules not processed for user `c686b1bd54314a5abed858123b050a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:23.299085 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:23.361843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1325/2633] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:23 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:23.371834 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:23.373520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:23.428842 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a756b-cd49-4926-9d00-6f8872d2af73 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:23.432485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766d85-f64e-42ba-95d7-cdafebbaa497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:23.433120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766d85-f64e-42ba-95d7-cdafebbaa497 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:23.433407 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766d85-f64e-42ba-95d7-cdafebbaa497 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:23.433680 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766d85-f64e-42ba-95d7-cdafebbaa497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:23.442132 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766d85-f64e-42ba-95d7-cdafebbaa497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:23.443587 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09766d85-f64e-42ba-95d7-cdafebbaa497 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:23.452000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1309/2634] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:23 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:34.635936 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:34.695759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90757ec0-6dd3-4a4b-9be7-28fa2e57feb6 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:34.700325 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:34.701183 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:34.701462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:34.701732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] PATH_INFO: `/v3/users/c686b1bd54314a5abed858123b050a0e` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:34.702981 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c686b1bd54314a5abed858123b050a0e)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:34.704939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:34.884297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c686b1bd54314a5abed858123b050a0e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:34.895624 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c686b1bd54314a5abed858123b050a0e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:34.902082 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c686b1bd54314a5abed858123b050a0e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:34.979411 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c686b1bd54314a5abed858123b050a0e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:34.980032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c686b1bd54314a5abed858123b050a0e'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:34.986236 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1326/2635] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:23:34 2021] DELETE /identity/v3/users/c686b1bd54314a5abed858123b050a0e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:34.990715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:34.991210 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:34.991873 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.008899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:35.010082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:35.064888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1310/2636] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:35.075001 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:35.076681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:35.135479 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424dea2c-0d00-46aa-b33a-8dd1e67e790e admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:35.139278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1890cc30-e3e3-4384-8a8d-ec585e75355c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:35.139926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cc30-e3e3-4384-8a8d-ec585e75355c service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:35.140214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cc30-e3e3-4384-8a8d-ec585e75355c service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:35.140487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1890cc30-e3e3-4384-8a8d-ec585e75355c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.153675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890cc30-e3e3-4384-8a8d-ec585e75355c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:35.155148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1890cc30-e3e3-4384-8a8d-ec585e75355c service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:35.165547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1327/2637] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:35.575041 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:35.576502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:35.590885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dee061-5571-4de0-a33c-0e5ec107c481 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:35.595912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:35.596788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:35.597071 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:35.597343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] PATH_INFO: `/v3/projects/9878474d1482482daf32645bd6cf6c48` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.598535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9878474d1482482daf32645bd6cf6c48)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:35.600478 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:35.727697 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9878474d1482482daf32645bd6cf6c48', 'request_id': 'req-7c62351d-baf0-42f9-ba4e-38da7671def5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:35.734005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9878474d1482482daf32645bd6cf6c48', 'request_id': 'req-7c62351d-baf0-42f9-ba4e-38da7671def5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:35.802130 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9878474d1482482daf32645bd6cf6c48', 'request_id': 'req-7c62351d-baf0-42f9-ba4e-38da7671def5'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:35.813092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] The token cache is being invalidate because project 9878474d1482482daf32645bd6cf6c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:23:35.813378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:35.813991 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7c62351d-baf0-42f9-ba4e-38da7671def5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:35.815526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1311/2638] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:23:35 2021] DELETE /identity/v3/projects/9878474d1482482daf32645bd6cf6c48 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:35.823319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:35.823784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:35.827047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.841257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:35.842424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:35.898354 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1328/2639] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:35.907312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:35.907605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:35.907885 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.925746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:35.926969 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:35.935192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1312/2640] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:35.939265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:35.949281 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b7ad6-d87c-4cd7-a78b-760612b388e5 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:35.953765 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:35.954407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:35.954709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:35.954980 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.955688 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:23:35.955989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:35.957571 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:35.968520 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1329/2641] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:23:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:23:35.972823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:35.981796 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da21e79-4ad0-4c3f-ab7f-8d64af56f4e6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:35.986827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:35.987471 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:35.987748 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:35.988018 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:35.988728 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:35.990652 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:36.078001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1313/2642] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:23:35 2021] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:23:36.082019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:36.092108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364558a-8121-4b10-a14a-f6889698b6d6 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:36.146160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:36.146890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:36.147173 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:36.147443 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:36.148125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:36.150101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:36.245939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1330/2643] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:23:36 2021] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:23:36.247852 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:36.258104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37694-6613-44b3-b994-cbdc1a315b9d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:36.262726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:36.263391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:36.263960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:36.264241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:36.264962 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:36.266549 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:36.276769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1314/2644] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:36 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:36.280813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:36.291614 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa2dd1-3699-47b2-bab2-e0dc0178058f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:36.296437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f31908-174c-491f-9d92-0b9442abb378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:36.297098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f31908-174c-491f-9d92-0b9442abb378 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:36.297383 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f31908-174c-491f-9d92-0b9442abb378 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:36.297661 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f31908-174c-491f-9d92-0b9442abb378 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:36.298459 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f31908-174c-491f-9d92-0b9442abb378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:36.300098 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f31908-174c-491f-9d92-0b9442abb378 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:36.315157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1331/2645] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:36.316520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:36.326894 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f9ed4-edc6-492a-96b9-fd3c0688469d admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:36.331851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:36.333159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:36.333513 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:36.333868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] PATH_INFO: `/v3/projects/ea6a28118fed4568a62deb8f8326a3ce/users/5b1ae97ac20846f98584751422f8373b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:36.349272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea6a28118fed4568a62deb8f8326a3ce, user_id=5b1ae97ac20846f98584751422f8373b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:36.352667 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:36.432435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1315/2646] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:23:36 2021] PUT /identity/v3/projects/ea6a28118fed4568a62deb8f8326a3ce/users/5b1ae97ac20846f98584751422f8373b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:36.437718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:36.438083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:36.438428 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:36.458501 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:36.459752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:36.520114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1332/2647] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:36.530367 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:36.532291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:36.591078 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5416ec88-628e-4b6b-8ec7-186e506ae18c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:36.594809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:36.595538 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:36.595818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:36.596090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:36.607376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:36.607376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:36.617493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1316/2648] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:38.915295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:38.916830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:38.994005 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9232ae77-7821-4992-bf77-6ad3ebc0be85 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:39.000214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:39.000793 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:39.001045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:39.001322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:39.003825 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:39.089345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:39.099500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1294a-aa38-490c-bde4-1d95d3ca5ba6 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:39.114798 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1333/2649] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:38 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:42.974418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:42.984169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61df298-5fe7-4e43-af44-dd6fca773294 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:42.989753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:42.990656 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:42.991638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:42.992089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:42.999397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:43.023042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.023042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.023042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.023860 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.025501 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.037207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1317/2650] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:43.059799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] MFA Rules not processed for user `5b1ae97ac20846f98584751422f8373b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:43.061259 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:43.135718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1334/2651] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:43 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:43.140328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:43.150735 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fb493-cc09-470c-bd23-b1a03c927000 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:43.155582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:43.156470 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.157045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.157477 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.158319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.160419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.268421 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1318/2652] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:23:43 2021] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:23:43.272830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:43.284069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe970c-5a80-454c-b7a5-7d2aaef05fb3 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:43.347735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:43.348389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.349265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.349265 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.349859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.352526 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.445043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1335/2653] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:23:43 2021] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:23:43.446437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:43.456858 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d003-fba4-4650-8a89-0d46154d780a admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:43.462272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:43.463047 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.466514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.466514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.466514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.466514 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.478665 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1319/2654] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:43 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:43.483048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:43.496974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129e342-080f-4592-af0b-05493b59cd91 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:43.502648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:43.504068 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.505781 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.506078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] PATH_INFO: `/v3/projects/37fcd606f63a462392b5f28e0558db50/users/1c690007c26c4188ae7656507c0a7511/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.525103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fcd606f63a462392b5f28e0558db50, user_id=1c690007c26c4188ae7656507c0a7511, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.532999 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.621287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1336/2655] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:23:43 2021] PUT /identity/v3/projects/37fcd606f63a462392b5f28e0558db50/users/1c690007c26c4188ae7656507c0a7511/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:43.625245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:43.636042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf88f7-dd13-4d7f-ae14-da92ce3f2404 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:43.693313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7474e388-c41c-4dd2-8078-ff827272e14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:43.694036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e388-c41c-4dd2-8078-ff827272e14c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.694305 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e388-c41c-4dd2-8078-ff827272e14c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.694609 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7474e388-c41c-4dd2-8078-ff827272e14c admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.695344 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e388-c41c-4dd2-8078-ff827272e14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.696940 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7474e388-c41c-4dd2-8078-ff827272e14c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.707399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1320/2656] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:23:43 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:23:43.711393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:43.724885 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765b75d-5a80-4b17-82ea-cc4b5c7a8c9b admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:43.731693 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:43.732812 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:43.733285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:43.733685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] PATH_INFO: `/v3/projects/37fcd606f63a462392b5f28e0558db50/users/1c690007c26c4188ae7656507c0a7511/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:43.736105 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=37fcd606f63a462392b5f28e0558db50, user_id=1c690007c26c4188ae7656507c0a7511, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:43.738886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:43.750047 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1337/2657] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:23:43 2021] PUT /identity/v3/projects/37fcd606f63a462392b5f28e0558db50/users/1c690007c26c4188ae7656507c0a7511/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:23:52.421009 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7c939-6c2e-4596-ad3b-e23120abb16e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:52.421458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7c939-6c2e-4596-ad3b-e23120abb16e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:52.421763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f7c939-6c2e-4596-ad3b-e23120abb16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:52.449719 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-05f7c939-6c2e-4596-ad3b-e23120abb16e None None] MFA Rules not processed for user `1c690007c26c4188ae7656507c0a7511`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:52.450977 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-05f7c939-6c2e-4596-ad3b-e23120abb16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:52.527949 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1321/2658] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:23:52 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:52.541447 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:52.545154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:52.625482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f132dc7-bfc0-4127-8b05-b221240d59ca admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:52.629527 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5350c5f195db471189281bf10b9cd9ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:52.630394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:52.631288 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:52.631640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:52.699061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:52.700888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:52.712303 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1338/2659] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:23:52 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:23:52.921184 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:52.921474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:52.921948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:52.949843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:23:52.951291 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:53.017797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1322/2660] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:23:52 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:23:53.160345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:53.161766 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:53.273612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413e6b9-1a51-4eea-9b76-1fe1ee13a929 service glance] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:53.280621 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:53.281416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:53.281775 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:53.282169 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:53.293200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:53.295274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:53.306314 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1339/2661] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:23:53 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:23:54.136473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:54.137952 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:54.280068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e343760-4685-403f-8225-7950acfb2d82 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:54.288309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:54.289571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:54.290008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:54.291219 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] PATH_INFO: `/v3/users/3378945fb3734bb395995268af72960d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:54.292675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3378945fb3734bb395995268af72960d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:54.295369 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:54.547763 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3378945fb3734bb395995268af72960d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:54.580182 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3378945fb3734bb395995268af72960d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:54.694283 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3378945fb3734bb395995268af72960d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:54.706550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3378945fb3734bb395995268af72960d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:54.707328 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3378945fb3734bb395995268af72960d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:54.714240 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1323/2662] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:23:54 2021] DELETE /identity/v3/users/3378945fb3734bb395995268af72960d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:55.078750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:55.092393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e385e-137d-4fdc-a770-9cca459fd55f service swift] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:55.229228 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:55.231040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:55.231747 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:55.232206 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] PATH_INFO: `/v3/projects/0b0757c9f3474f1d8d45d02c87abef53` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:55.234157 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b0757c9f3474f1d8d45d02c87abef53)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:55.241463 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:55.440976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b0757c9f3474f1d8d45d02c87abef53', 'request_id': 'req-204da531-a8e6-460e-b420-a6b9cceb19df'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:55.451102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b0757c9f3474f1d8d45d02c87abef53', 'request_id': 'req-204da531-a8e6-460e-b420-a6b9cceb19df'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:55.527004 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b0757c9f3474f1d8d45d02c87abef53', 'request_id': 'req-204da531-a8e6-460e-b420-a6b9cceb19df'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:55.544050 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] The token cache is being invalidate because project 0b0757c9f3474f1d8d45d02c87abef53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:23:55.544335 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:55.544996 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:55.549539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1340/2663] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:23:55 2021] DELETE /identity/v3/projects/0b0757c9f3474f1d8d45d02c87abef53 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:55.550741 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:55.554512 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:55.576831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047dc2c1-6ef2-4e1f-86dd-2efbaba7cef7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:55.659765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:55.661543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:55.661543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:55.661543 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] PATH_INFO: `/v3/users/ed66063e031446a6ba20af7d88585b6d` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:55.663055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed66063e031446a6ba20af7d88585b6d)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:55.665554 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:55.899958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed66063e031446a6ba20af7d88585b6d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:55.918108 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed66063e031446a6ba20af7d88585b6d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.034880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed66063e031446a6ba20af7d88585b6d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.047558 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed66063e031446a6ba20af7d88585b6d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.048617 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed66063e031446a6ba20af7d88585b6d'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.067104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1324/2664] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:23:55 2021] DELETE /identity/v3/users/ed66063e031446a6ba20af7d88585b6d => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:23:56.572016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:23:56.573278 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:23:56.604100 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da531-a8e6-460e-b420-a6b9cceb19df admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:23:56.698662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:23:56.699918 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:23:56.703606 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:23:56.704148 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] PATH_INFO: `/v3/projects/97411a9801ba4537b5f8c5607c920a7d` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:23:56.705762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=97411a9801ba4537b5f8c5607c920a7d)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:23:56.708087 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:23:56.863279 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97411a9801ba4537b5f8c5607c920a7d', 'request_id': 'req-f1b694aa-b62b-4318-95ca-7e539dcd21fe'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.876065 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97411a9801ba4537b5f8c5607c920a7d', 'request_id': 'req-f1b694aa-b62b-4318-95ca-7e539dcd21fe'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.939389 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97411a9801ba4537b5f8c5607c920a7d', 'request_id': 'req-f1b694aa-b62b-4318-95ca-7e539dcd21fe'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.952655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] The token cache is being invalidate because project 97411a9801ba4537b5f8c5607c920a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:23:56.953363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.954143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:23:56.956668 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1341/2665] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:23:56 2021] DELETE /identity/v3/projects/97411a9801ba4537b5f8c5607c920a7d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:00.738691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:00.740218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:00.757717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f10f22a-63ec-4f51-9513-db0cd368fd31 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:00.815189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:00.816070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:00.816461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:00.816746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] PATH_INFO: `/v3/users/7021089fd78c4c70b303877e71bc6215` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:00.819034 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7021089fd78c4c70b303877e71bc6215)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:00.821485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:00.952814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7021089fd78c4c70b303877e71bc6215'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:00.966335 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7021089fd78c4c70b303877e71bc6215'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.036076 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7021089fd78c4c70b303877e71bc6215'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.044313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7021089fd78c4c70b303877e71bc6215'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.045178 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-ea1b1d48-c368-4453-b6ce-14afc514502a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7021089fd78c4c70b303877e71bc6215'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.055899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1325/2666] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:00 2021] DELETE /identity/v3/users/7021089fd78c4c70b303877e71bc6215 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:01.305784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:01.307405 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:01.322926 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b694aa-b62b-4318-95ca-7e539dcd21fe admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:01.395562 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:01.397431 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:01.397823 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:01.399010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] PATH_INFO: `/v3/projects/9c1e88b565f34674a368e054f0a19cd8` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:01.400646 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1e88b565f34674a368e054f0a19cd8)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:01.402723 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:01.498637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1e88b565f34674a368e054f0a19cd8', 'request_id': 'req-7560a45b-2816-4d63-917b-94499182e894'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.505101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1e88b565f34674a368e054f0a19cd8', 'request_id': 'req-7560a45b-2816-4d63-917b-94499182e894'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.561722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1e88b565f34674a368e054f0a19cd8', 'request_id': 'req-7560a45b-2816-4d63-917b-94499182e894'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.574758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] The token cache is being invalidate because project 9c1e88b565f34674a368e054f0a19cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:01.574758 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.575214 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-7560a45b-2816-4d63-917b-94499182e894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:01.576785 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1342/2667] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:01 2021] DELETE /identity/v3/projects/9c1e88b565f34674a368e054f0a19cd8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:01.583934 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:01.584276 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:01.584552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:01.605241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:01.606561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:01.673867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1326/2668] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:01.682186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:01.682476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:01.682947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:01.705537 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:01.706843 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:01.727204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1343/2669] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:01.731642 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:01.747848 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474e431-2fb1-4f67-bc03-400c8a5e4d7c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:01.753591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:01.754710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:01.754710 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:01.755815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:01.756714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:24:01.757247 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:01.758844 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:01.775516 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1327/2670] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:24:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:24:01.776740 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:01.791040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9de3f-5691-460f-bed7-b6d0fea8869b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:01.801102 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:01.802387 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:01.802934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:01.803441 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:01.804403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:01.807054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:01.904487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1344/2671] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:01 2021] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:01.908638 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:01.919840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441690f9-34b6-4a83-a99c-5238aa70875f admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:01.984091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:01.984761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:01.985302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:01.986106 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:01.986766 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:01.988518 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:02.072401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1328/2672] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:01 2021] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:02.076655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:02.090046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66761b-92db-482c-ae65-e4ae72dc7ec1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:02.094964 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:02.095751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:02.096302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:02.096722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:02.097494 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:02.099419 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:02.115715 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:02.116845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1345/2673] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:02 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:02.126838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfdd31-edb9-4cfb-b735-c865a735c4fd admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:02.132379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8ccd5-3dcc-4fc3-9f9d-6e63ba589047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:02.133176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ccd5-3dcc-4fc3-9f9d-6e63ba589047 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:02.133460 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ccd5-3dcc-4fc3-9f9d-6e63ba589047 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:02.133742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8ccd5-3dcc-4fc3-9f9d-6e63ba589047 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:02.134448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ccd5-3dcc-4fc3-9f9d-6e63ba589047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:02.136201 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8ccd5-3dcc-4fc3-9f9d-6e63ba589047 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:02.150624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1329/2674] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:02 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:24:02.153683 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:02.166767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234531f-227e-4393-847a-8105766dc5d0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:02.171595 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:02.172482 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:02.172767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:02.173048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] PATH_INFO: `/v3/projects/c8f576e68c0248a494b52141eee6ac52/users/b0a84a34702e42eca8667a6f5bd22e92/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:02.191448 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8f576e68c0248a494b52141eee6ac52, user_id=b0a84a34702e42eca8667a6f5bd22e92, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:02.194713 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:02.283503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1346/2675] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:02 2021] PUT /identity/v3/projects/c8f576e68c0248a494b52141eee6ac52/users/b0a84a34702e42eca8667a6f5bd22e92/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:02.293753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46285c4-bf28-477a-8ccd-e43bd8c9c9c5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:02.294049 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46285c4-bf28-477a-8ccd-e43bd8c9c9c5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:02.294321 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46285c4-bf28-477a-8ccd-e43bd8c9c9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:02.327809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-d46285c4-bf28-477a-8ccd-e43bd8c9c9c5 None None] MFA Rules not processed for user `b0a84a34702e42eca8667a6f5bd22e92`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:02.329304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d46285c4-bf28-477a-8ccd-e43bd8c9c9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:02.412922 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1330/2676] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:02 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:02.424349 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:02.427113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:02.509871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bef7e-5c83-4811-9016-799e032eb636 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:02.516453 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:02.517136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:02.517416 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:02.517694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:02.526871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:02.532182 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:02.544435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1347/2677] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:02 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:05.137891 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab64de-9cc3-4f9c-88af-d20683746717 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:05.138427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab64de-9cc3-4f9c-88af-d20683746717 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:05.138427 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab64de-9cc3-4f9c-88af-d20683746717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:05.156235 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-8bab64de-9cc3-4f9c-88af-d20683746717 None None] MFA Rules not processed for user `5b1ae97ac20846f98584751422f8373b`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:05.157415 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8bab64de-9cc3-4f9c-88af-d20683746717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:05.210714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1331/2678] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:05 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:05.762048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:05.827454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b9996b-f2a1-4379-9a6b-21ab9061061d service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:05.832513 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:05.833395 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:05.833680 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:05.833956 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] PATH_INFO: `/v3/users/b0a84a34702e42eca8667a6f5bd22e92` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:05.835165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a84a34702e42eca8667a6f5bd22e92)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:05.837095 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:05.998009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a84a34702e42eca8667a6f5bd22e92'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.011917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a84a34702e42eca8667a6f5bd22e92'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.018670 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a84a34702e42eca8667a6f5bd22e92'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.081421 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a84a34702e42eca8667a6f5bd22e92'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.082099 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a84a34702e42eca8667a6f5bd22e92'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.088511 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1348/2679] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:05 2021] DELETE /identity/v3/users/b0a84a34702e42eca8667a6f5bd22e92 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:06.092988 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:06.093304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:06.093580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:06.111092 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:06.112302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:06.168113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1332/2680] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:06.178391 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:06.179873 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:06.235612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ba08f-57d0-4a65-9fba-1198443d2605 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:06.239394 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d5580-24b1-4d66-9d7e-6a14d932a7a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:06.240648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5580-24b1-4d66-9d7e-6a14d932a7a3 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:06.240931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5580-24b1-4d66-9d7e-6a14d932a7a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:06.241203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d5580-24b1-4d66-9d7e-6a14d932a7a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:06.250407 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d5580-24b1-4d66-9d7e-6a14d932a7a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:06.251944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d5580-24b1-4d66-9d7e-6a14d932a7a3 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:06.261384 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1349/2681] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:06.756639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:06.757978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:06.772784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820d59-ff3e-4480-884d-73c145d6207a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:06.778567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:06.779510 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:06.779928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:06.780381 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] PATH_INFO: `/v3/projects/c8f576e68c0248a494b52141eee6ac52` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:06.782352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8f576e68c0248a494b52141eee6ac52)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:06.784443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:06.898243 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8f576e68c0248a494b52141eee6ac52', 'request_id': 'req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.904589 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8f576e68c0248a494b52141eee6ac52', 'request_id': 'req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.984495 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8f576e68c0248a494b52141eee6ac52', 'request_id': 'req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.995743 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] The token cache is being invalidate because project c8f576e68c0248a494b52141eee6ac52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:06.996038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.996666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-bcf938d8-498d-4be3-b7b7-5df12e85c4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:06.998195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1333/2682] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:06 2021] DELETE /identity/v3/projects/c8f576e68c0248a494b52141eee6ac52 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:07.003859 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.004308 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.004400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.022883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:07.024073 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:07.080544 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1350/2683] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:07.089039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.089333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.089615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.107878 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:07.109146 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:07.119129 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1334/2684] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:07.128213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.138083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775be242-b776-4995-9792-1ec6a9c1df2e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.142997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.143650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.143931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.144203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.144916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:24:07.145218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.147386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.159283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1351/2685] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:24:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:24:07.163420 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.172500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802c888-1f78-44e9-a2de-c54243e5ac0a None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.177171 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.177818 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.178101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.178376 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.179104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.181000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.238193 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.240440 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:07.294533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1335/2686] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:07.298493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.309480 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7d29-855f-4b7f-89c4-9dd52a329443 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.365330 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915339d8-6d17-45f7-8c95-e44a45a5e46e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.369149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.369799 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.370080 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.370194 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.370355 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.370896 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.371179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.371456 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.372140 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.372312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:07.374045 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.384101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.385678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.395368 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1352/2687] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:07 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:24:07.469786 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1336/2688] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:24:07.473839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.485902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a408-bff9-417d-8d19-799983ab7127 service placement] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.491167 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.491827 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.492111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.492386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.493101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.494759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.504777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1353/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:07.509430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.519467 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f40d47-8157-4aaa-9cdb-95745919d633 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.524445 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c950cbf-625c-43d2-b045-66ab215dac7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.525111 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950cbf-625c-43d2-b045-66ab215dac7d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.525395 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950cbf-625c-43d2-b045-66ab215dac7d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.525714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c950cbf-625c-43d2-b045-66ab215dac7d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.526399 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c950cbf-625c-43d2-b045-66ab215dac7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.528027 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c950cbf-625c-43d2-b045-66ab215dac7d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.538068 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1337/2690] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:07 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:07.542435 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.552974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7128683-d7d4-4ec1-9bf2-1be05518c5d1 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.557530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.558399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.558744 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.559019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] PATH_INFO: `/v3/projects/86733e883bdd4d6fa155546744de02bc/users/7af46b6d81c24ed1b1972d8ac4947ea9/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.575660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=86733e883bdd4d6fa155546744de02bc, user_id=7af46b6d81c24ed1b1972d8ac4947ea9, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.578360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.658351 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1354/2691] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:07 2021] PUT /identity/v3/projects/86733e883bdd4d6fa155546744de02bc/users/7af46b6d81c24ed1b1972d8ac4947ea9/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:07.670832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.671151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.671430 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.699082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] MFA Rules not processed for user `7af46b6d81c24ed1b1972d8ac4947ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:07.700319 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:07.763120 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1338/2692] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:24:07.767881 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.826707 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a204f-f236-4f33-950a-a49c31ec4bfe admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:07.831346 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:07.832003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:07.832286 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:07.832563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:07.833255 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:07.835287 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:07.961963 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1355/2693] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:07.965961 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:07.976876 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a49b6-225b-4b00-b075-0fc523f95e62 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.030503 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.031209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.031481 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.031753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.032432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.034326 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.110266 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1339/2694] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:07 2021] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:08.114032 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:08.124322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95829e-c1e6-485d-8110-7a79f55f1c94 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.129468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.130155 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.130437 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.130750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.136107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.136107 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.143928 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1356/2695] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:08.148515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:08.158675 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0b056-f439-43cf-b8ab-1e71f08f6913 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.164067 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.165028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.165313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.165591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] PATH_INFO: `/v3/projects/d1a9ffcdf2f04793872574126c027ab8/users/a20bbf27b69245a2a2a8e6aa1d3a72d1/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.180029 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a9ffcdf2f04793872574126c027ab8, user_id=a20bbf27b69245a2a2a8e6aa1d3a72d1, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.182755 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.264115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1340/2696] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:08 2021] PUT /identity/v3/projects/d1a9ffcdf2f04793872574126c027ab8/users/a20bbf27b69245a2a2a8e6aa1d3a72d1/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:24:08.268124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:08.278396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddaa90c-0ed3-4d99-872a-ec5f767752c7 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.369542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de8c0-cb73-4381-ad09-3ad445679f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.370159 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de8c0-cb73-4381-ad09-3ad445679f66 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.370460 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de8c0-cb73-4381-ad09-3ad445679f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.370779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de8c0-cb73-4381-ad09-3ad445679f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.374947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69de8c0-cb73-4381-ad09-3ad445679f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.374947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69de8c0-cb73-4381-ad09-3ad445679f66 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.385548 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1357/2697] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:08 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:08.389677 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:08.400928 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138118a-3f9d-4c01-b132-044ccd02c556 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.405759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.406671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.406951 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.407222 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] PATH_INFO: `/v3/projects/d1a9ffcdf2f04793872574126c027ab8/users/a20bbf27b69245a2a2a8e6aa1d3a72d1/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.409187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1a9ffcdf2f04793872574126c027ab8, user_id=a20bbf27b69245a2a2a8e6aa1d3a72d1, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.412062 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.423561 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1341/2698] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:08 2021] PUT /identity/v3/projects/d1a9ffcdf2f04793872574126c027ab8/users/a20bbf27b69245a2a2a8e6aa1d3a72d1/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:08.434072 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.434362 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.434675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.465064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] MFA Rules not processed for user `a20bbf27b69245a2a2a8e6aa1d3a72d1`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:08.466339 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:08.534418 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1358/2699] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:08 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:08.544881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:08.546671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:08.605827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bcf96-cfdf-414d-b338-75b1ad1415d8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.609746 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32e600-0565-48b2-aa84-e57346a64d4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.610765 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e600-0565-48b2-aa84-e57346a64d4e service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.611073 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e600-0565-48b2-aa84-e57346a64d4e service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.611333 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32e600-0565-48b2-aa84-e57346a64d4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.620500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32e600-0565-48b2-aa84-e57346a64d4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.621880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e32e600-0565-48b2-aa84-e57346a64d4e service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.631779 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1342/2700] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:08 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:08.836550 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:08.846189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbde6bc-9721-4d70-9a6d-85c906c6dfc7 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:08.849842 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:08.850488 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.850806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.851084 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.911217 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:08.912922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:08.922317 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1359/2701] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:08 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:08.936857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:08.937457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:08.937833 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:08.957807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:08.959096 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:09.013353 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1343/2702] 10.222.0.16 () {58 vars in 1010 bytes} [Tue Aug 10 05:24:08 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:09.026965 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:09.028400 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:09.096603 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3de48-b09d-401c-a85b-c7e76576f062 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:09.102178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927f7a4-9da3-41ec-8b3d-ecfe6e46369e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:09.102880 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927f7a4-9da3-41ec-8b3d-ecfe6e46369e service swift] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:09.103154 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927f7a4-9da3-41ec-8b3d-ecfe6e46369e service swift] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:09.103552 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927f7a4-9da3-41ec-8b3d-ecfe6e46369e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:09.116243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927f7a4-9da3-41ec-8b3d-ecfe6e46369e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:09.117893 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927f7a4-9da3-41ec-8b3d-ecfe6e46369e service swift] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:09.128165 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1360/2703] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:24:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:24:21.303362 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:21.363643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a90024-f876-4fbf-99bb-ea888af114b6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:21.368272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:21.369136 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:21.369416 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:21.369693 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] PATH_INFO: `/v3/users/7af46b6d81c24ed1b1972d8ac4947ea9` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:21.370957 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af46b6d81c24ed1b1972d8ac4947ea9)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:21.372864 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:21.546799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af46b6d81c24ed1b1972d8ac4947ea9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:21.558500 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af46b6d81c24ed1b1972d8ac4947ea9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:21.640371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af46b6d81c24ed1b1972d8ac4947ea9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:21.647213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af46b6d81c24ed1b1972d8ac4947ea9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:21.647830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af46b6d81c24ed1b1972d8ac4947ea9'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:21.653602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1344/2704] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:21 2021] DELETE /identity/v3/users/7af46b6d81c24ed1b1972d8ac4947ea9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:21.658264 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:21.658802 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:21.658922 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:21.675474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:21.676652 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:21.738709 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1361/2705] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:21.748971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:21.750349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:21.805417 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8434a49-58cb-46b9-98a1-bcf47b602998 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:21.809053 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:21.809696 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:21.809980 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:21.810252 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:21.819535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:21.820955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:21.830112 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1345/2706] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:22.265509 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:22.269782 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:22.279257 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ab46b-a82b-4d2d-abac-ad292f3f547d None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:22.284040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:22.284919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:22.285253 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:22.285533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] PATH_INFO: `/v3/projects/86733e883bdd4d6fa155546744de02bc` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:22.287396 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86733e883bdd4d6fa155546744de02bc)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:22.289304 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:22.400632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86733e883bdd4d6fa155546744de02bc', 'request_id': 'req-cecf70af-5977-44f2-9b6e-5f5212d7b187'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.406635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86733e883bdd4d6fa155546744de02bc', 'request_id': 'req-cecf70af-5977-44f2-9b6e-5f5212d7b187'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.480461 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86733e883bdd4d6fa155546744de02bc', 'request_id': 'req-cecf70af-5977-44f2-9b6e-5f5212d7b187'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.490846 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] The token cache is being invalidate because project 86733e883bdd4d6fa155546744de02bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:22.491135 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.498417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.498417 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1362/2707] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:22 2021] DELETE /identity/v3/projects/86733e883bdd4d6fa155546744de02bc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:22.498681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:22.506655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920cf5-9aef-495e-abc4-a2b598473e2b service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:22.561119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:22.561992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:22.562273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:22.562546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] PATH_INFO: `/v3/users/a20bbf27b69245a2a2a8e6aa1d3a72d1` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:22.563753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a20bbf27b69245a2a2a8e6aa1d3a72d1)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:22.565669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:22.813807 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a20bbf27b69245a2a2a8e6aa1d3a72d1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.825663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a20bbf27b69245a2a2a8e6aa1d3a72d1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.897302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a20bbf27b69245a2a2a8e6aa1d3a72d1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.904119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a20bbf27b69245a2a2a8e6aa1d3a72d1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.904772 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-4ce4afbf-9fa8-46e5-8ddb-64d14f38b8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a20bbf27b69245a2a2a8e6aa1d3a72d1'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:22.910536 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1346/2708] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:22 2021] DELETE /identity/v3/users/a20bbf27b69245a2a2a8e6aa1d3a72d1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:23.320260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:23.322953 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:23.336662 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf70af-5977-44f2-9b6e-5f5212d7b187 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:23.389921 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:23.390800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:23.391082 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:23.391357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] PATH_INFO: `/v3/projects/d1a9ffcdf2f04793872574126c027ab8` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:23.392512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1a9ffcdf2f04793872574126c027ab8)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:23.394403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:23.508406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1a9ffcdf2f04793872574126c027ab8', 'request_id': 'req-b74404e3-769e-42a6-91cd-afe4b5398921'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:23.514176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1a9ffcdf2f04793872574126c027ab8', 'request_id': 'req-b74404e3-769e-42a6-91cd-afe4b5398921'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:23.572149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1a9ffcdf2f04793872574126c027ab8', 'request_id': 'req-b74404e3-769e-42a6-91cd-afe4b5398921'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:23.582706 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] The token cache is being invalidate because project d1a9ffcdf2f04793872574126c027ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:23.582995 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:23.584225 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b74404e3-769e-42a6-91cd-afe4b5398921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:23.585790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1363/2709] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:23 2021] DELETE /identity/v3/projects/d1a9ffcdf2f04793872574126c027ab8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:23.591509 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:23.591964 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:23.595343 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:23.610313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:23.611643 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:23.667185 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1347/2710] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:23.675040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:23.675328 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:23.675633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:23.693711 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:23.694931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:23.702742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1364/2711] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:23.706909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:23.716867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a0025-8aa3-4d75-8918-99cc27adb1b6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:23.721550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:23.722196 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:23.722473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:23.722774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:23.723487 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:24:23.723875 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:23.725458 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:23.736654 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1348/2712] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:24:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 10 05:24:23.741201 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:23.749931 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786e1de5-a814-4ba2-bf94-6cf1cd6e902a None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:23.754516 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:23.755767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:23.756044 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:23.756312 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:23.757002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:23.758912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:23.888371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1365/2713] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:23 2021] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:24:23.892682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:23.903026 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b74c6-973c-4d12-8029-3bf6355215e7 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:23.956148 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:23.956814 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:23.957093 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:23.957364 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:23.958046 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:23.959975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.046641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1349/2714] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:23 2021] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:24.050940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.061650 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7dd99-2873-42d6-9bc9-99aaeb2149b0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.066378 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.067186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.068152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.068429 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.069142 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.070751 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.080919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1366/2715] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:24.084740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.094799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022cf563-3943-41e4-bb38-c1d7c2cf582e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.100197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7cd93-ebc7-4d34-9dc6-b39b8ba676fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.100857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7cd93-ebc7-4d34-9dc6-b39b8ba676fd admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.101144 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7cd93-ebc7-4d34-9dc6-b39b8ba676fd admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.101422 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7cd93-ebc7-4d34-9dc6-b39b8ba676fd admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.102174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7cd93-ebc7-4d34-9dc6-b39b8ba676fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.103859 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7cd93-ebc7-4d34-9dc6-b39b8ba676fd admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.113582 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1350/2716] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:24.118181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.128189 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c7bb4-a91d-4adb-a365-aad84d6fda71 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.132883 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.133752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.134036 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.134313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] PATH_INFO: `/v3/projects/bf3a1748dfe545ccb6316459178952bc/users/7bcb38803f58412ca937c230756b2a57/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.148460 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3a1748dfe545ccb6316459178952bc, user_id=7bcb38803f58412ca937c230756b2a57, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.151101 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.217555 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1367/2717] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:24 2021] PUT /identity/v3/projects/bf3a1748dfe545ccb6316459178952bc/users/7bcb38803f58412ca937c230756b2a57/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:24.229141 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.229431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.229711 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.255832 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] MFA Rules not processed for user `7bcb38803f58412ca937c230756b2a57`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:24.257043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:24.320769 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1351/2718] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:24 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:24.325233 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.384840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31e515b-401f-46cb-9b52-5d5e281a806f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.390338 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.391028 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.391319 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.391623 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.392324 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.394241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.476875 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1368/2719] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:24 2021] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:24:24.484048 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.494857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0371bde7-a8b9-4856-a838-5e7bc5f3a875 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.549055 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.549726 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.550008 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.550281 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.550995 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.552915 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.652285 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1352/2720] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:24 2021] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:24.656203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.667035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1267cde-77af-46b4-bf32-864044df93dc admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.671685 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.672280 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.672565 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.672841 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.673560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.675187 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.685337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1369/2721] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:24.689100 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.698751 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c55f6-fcdc-4bc4-aefb-13655dd0dc7c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.703356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c06dd1-039f-461c-aa72-415e71356888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.704005 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c06dd1-039f-461c-aa72-415e71356888 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.704290 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c06dd1-039f-461c-aa72-415e71356888 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.704567 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c06dd1-039f-461c-aa72-415e71356888 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.705279 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c06dd1-039f-461c-aa72-415e71356888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.706881 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c06dd1-039f-461c-aa72-415e71356888 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.716893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1353/2722] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:24.720594 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.730871 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b6ea3-af16-4690-b238-1791e79a4069 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.735712 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.736568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.736851 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.737126 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] PATH_INFO: `/v3/projects/0ab96171676742b8b472bfb9ca54d47b/users/a6f9aead239448ba92d2f4a29a50ac2f/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.751009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ab96171676742b8b472bfb9ca54d47b, user_id=a6f9aead239448ba92d2f4a29a50ac2f, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.753629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:24.823162 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1370/2723] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:24 2021] PUT /identity/v3/projects/0ab96171676742b8b472bfb9ca54d47b/users/a6f9aead239448ba92d2f4a29a50ac2f/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:24.833731 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.834001 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.834280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.860410 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] MFA Rules not processed for user `a6f9aead239448ba92d2f4a29a50ac2f`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:24.861604 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:24.922207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1354/2724] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:24 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:24:24.926519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:24.987390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b470086-5074-4e1f-a3a4-8f993d6b2fc0 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:24.992106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:24.992763 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:24.993048 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:24.993322 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:24.994012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:24.995944 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.077302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1371/2725] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:24 2021] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:25.082596 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.092846 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550eba3-07e1-4c1d-9842-022294662fb5 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.151702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.152382 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.152662 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.152933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.153615 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.155577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.226794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1355/2726] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:25 2021] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:25.228025 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.238704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be89e0b-3730-4f6a-b276-42216ad4c389 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.244075 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.244784 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.245063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.245343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.246064 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.247730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.258413 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1372/2727] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:24:25.262546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.272776 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3abde-4bee-487e-86c0-f54573613b07 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.277439 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.278306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.278622 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.283448 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] PATH_INFO: `/v3/projects/fe388844804543de92028c973058f938/users/f62df492548d49f9b0a02aae6cb80c3a/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.293546 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe388844804543de92028c973058f938, user_id=f62df492548d49f9b0a02aae6cb80c3a, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.296269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.367571 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1356/2728] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:25 2021] PUT /identity/v3/projects/fe388844804543de92028c973058f938/users/f62df492548d49f9b0a02aae6cb80c3a/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:25.371702 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.382512 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c4629-2201-41f2-8adb-457864fa0726 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.437186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e32a0a0-08ef-4a06-b48f-17c74a325a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.437824 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a0a0-08ef-4a06-b48f-17c74a325a6a admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.438108 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a0a0-08ef-4a06-b48f-17c74a325a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.438388 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e32a0a0-08ef-4a06-b48f-17c74a325a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.439136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32a0a0-08ef-4a06-b48f-17c74a325a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.440735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e32a0a0-08ef-4a06-b48f-17c74a325a6a admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.450739 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1373/2729] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:25 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:24:25.454919 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.464965 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b13e6-a2ce-4bf4-ad6e-f16943a0f23e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.469523 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.470392 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.470704 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.470978 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] PATH_INFO: `/v3/projects/fe388844804543de92028c973058f938/users/f62df492548d49f9b0a02aae6cb80c3a/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.472908 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe388844804543de92028c973058f938, user_id=f62df492548d49f9b0a02aae6cb80c3a, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.475783 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.486280 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1357/2730] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:25 2021] PUT /identity/v3/projects/fe388844804543de92028c973058f938/users/f62df492548d49f9b0a02aae6cb80c3a/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:24:25.496806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.497181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.497523 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.526627 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] MFA Rules not processed for user `f62df492548d49f9b0a02aae6cb80c3a`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:25.527045 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:25.595002 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1374/2731] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:25 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:25.606016 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.607749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:25.669925 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d46ab-0632-4d92-b6eb-cc6e52e24ae8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.673655 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.674306 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.674606 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.674893 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.684365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.686007 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.695386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1358/2732] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:25 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:25.785630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:25.787715 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:25.799779 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029c94c-8b21-4666-9d7b-8a7fc1a978d3 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:25.804147 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b3e1b-458b-4987-988d-d904c616d26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:25.808927 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3e1b-458b-4987-988d-d904c616d26b service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:25.809204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3e1b-458b-4987-988d-d904c616d26b service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:25.809476 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b3e1b-458b-4987-988d-d904c616d26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:25.871991 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b3e1b-458b-4987-988d-d904c616d26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:25.873422 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b3e1b-458b-4987-988d-d904c616d26b service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:25.881993 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1375/2733] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:25 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:29.706261 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:29.765840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc6f57-b50a-4642-8fe2-62a2e8def3e1 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:29.770351 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:29.771245 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:29.771525 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:29.771801 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] PATH_INFO: `/v3/users/7bcb38803f58412ca937c230756b2a57` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:29.772959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcb38803f58412ca937c230756b2a57)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:29.774955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:29.939717 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcb38803f58412ca937c230756b2a57'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:29.951206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcb38803f58412ca937c230756b2a57'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.011706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcb38803f58412ca937c230756b2a57'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.018721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcb38803f58412ca937c230756b2a57'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.019352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcb38803f58412ca937c230756b2a57'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.025162 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1359/2734] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:29 2021] DELETE /identity/v3/users/7bcb38803f58412ca937c230756b2a57 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:30.029749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:30.030254 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:30.030357 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:30.048919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:30.048919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:30.105604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1376/2735] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:30.115960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:30.117365 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:30.178533 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f90ea9-f579-4397-b3fe-720c04eb9bb8 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:30.182400 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:30.183084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:30.183370 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:30.183646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:30.192522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:30.193960 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:30.203541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1360/2736] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:30.606876 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:30.609158 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:30.622241 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f65d5-6c67-4485-974a-93b148b46b4e None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:30.627251 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:30.628136 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:30.628560 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:30.628839 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] PATH_INFO: `/v3/projects/bf3a1748dfe545ccb6316459178952bc` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:30.630043 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3a1748dfe545ccb6316459178952bc)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:30.632011 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:30.759655 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3a1748dfe545ccb6316459178952bc', 'request_id': 'req-c8ff114a-470f-4daa-9cff-2896702a56ed'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.765629 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3a1748dfe545ccb6316459178952bc', 'request_id': 'req-c8ff114a-470f-4daa-9cff-2896702a56ed'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.828925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3a1748dfe545ccb6316459178952bc', 'request_id': 'req-c8ff114a-470f-4daa-9cff-2896702a56ed'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.839069 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] The token cache is being invalidate because project bf3a1748dfe545ccb6316459178952bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:30.839348 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.839970 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:30.841479 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1377/2737] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:30 2021] DELETE /identity/v3/projects/bf3a1748dfe545ccb6316459178952bc => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:30.845593 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:30.859401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fee83-1bf0-4e19-8e0d-311305258112 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:30.909522 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:30.910391 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:30.910709 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:30.910992 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] PATH_INFO: `/v3/users/a6f9aead239448ba92d2f4a29a50ac2f` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:30.912166 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f9aead239448ba92d2f4a29a50ac2f)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:30.914091 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:31.069889 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f9aead239448ba92d2f4a29a50ac2f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.082352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f9aead239448ba92d2f4a29a50ac2f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.125152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f9aead239448ba92d2f4a29a50ac2f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.131955 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f9aead239448ba92d2f4a29a50ac2f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.134310 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f9aead239448ba92d2f4a29a50ac2f'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.139388 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1361/2738] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:30 2021] DELETE /identity/v3/users/a6f9aead239448ba92d2f4a29a50ac2f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:31.557238 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:31.561539 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:31.571678 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff114a-470f-4daa-9cff-2896702a56ed admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:31.627067 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:31.627852 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:31.628204 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:31.628478 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] PATH_INFO: `/v3/projects/0ab96171676742b8b472bfb9ca54d47b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:31.629660 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ab96171676742b8b472bfb9ca54d47b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:31.631597 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:31.759232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ab96171676742b8b472bfb9ca54d47b', 'request_id': 'req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.765301 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ab96171676742b8b472bfb9ca54d47b', 'request_id': 'req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.846062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ab96171676742b8b472bfb9ca54d47b', 'request_id': 'req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.857442 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] The token cache is being invalidate because project 0ab96171676742b8b472bfb9ca54d47b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:31.857732 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.858364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:31.860177 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1378/2739] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:31 2021] DELETE /identity/v3/projects/0ab96171676742b8b472bfb9ca54d47b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:31.864152 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:31.865559 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:31.877968 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45599b-f879-495c-b609-27ee8eb38479 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:31.932661 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:31.933535 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:31.933816 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:31.934090 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] PATH_INFO: `/v3/users/f62df492548d49f9b0a02aae6cb80c3a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:31.935371 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62df492548d49f9b0a02aae6cb80c3a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:31.937193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:32.151239 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62df492548d49f9b0a02aae6cb80c3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.162317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62df492548d49f9b0a02aae6cb80c3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.240712 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62df492548d49f9b0a02aae6cb80c3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.248623 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62df492548d49f9b0a02aae6cb80c3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.249302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5ae00639-bd2f-4781-ac97-73dfba0ca57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62df492548d49f9b0a02aae6cb80c3a'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.255187 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1362/2740] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:31 2021] DELETE /identity/v3/users/f62df492548d49f9b0a02aae6cb80c3a => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:32.641940 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:32.643462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:32.656943 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0e1c6-0afa-431a-99a3-fa372fb8c8c3 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:32.712297 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:32.713248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:32.713530 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:32.713804 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] PATH_INFO: `/v3/projects/fe388844804543de92028c973058f938` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:32.715006 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe388844804543de92028c973058f938)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:32.716974 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:32.833567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe388844804543de92028c973058f938', 'request_id': 'req-b002b5ff-6624-4e3e-a88c-6d97f2967994'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.839542 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe388844804543de92028c973058f938', 'request_id': 'req-b002b5ff-6624-4e3e-a88c-6d97f2967994'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.908831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe388844804543de92028c973058f938', 'request_id': 'req-b002b5ff-6624-4e3e-a88c-6d97f2967994'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.920462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] The token cache is being invalidate because project fe388844804543de92028c973058f938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:32.920462 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.920830 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b002b5ff-6624-4e3e-a88c-6d97f2967994 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:32.922490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1379/2741] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:32 2021] DELETE /identity/v3/projects/fe388844804543de92028c973058f938 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:32.929234 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:32.929702 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:32.929815 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:32.948349 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:32.949564 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:33.006672 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1363/2742] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:33.016063 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.016353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.016638 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.035019 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:33.040972 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:33.045078 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1380/2743] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:33.049191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.058648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5eb36-af63-406e-b448-66455b59ba4e None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.063151 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.063799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.064083 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.064359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] PATH_INFO: `/v3/domains` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.065074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:24:33.065387 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.066997 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.078302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1364/2744] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:24:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:24:33.082745 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.092172 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5cbab5-104b-40a4-9af5-0dcf95edad6b None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.096731 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.097373 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.097648 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.097919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.098640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.100554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.178310 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1381/2745] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:33 2021] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:33.182569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.192197 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59d58f-0051-42c5-b5c5-688807fca96c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.245515 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.246174 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.246452 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.246757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] PATH_INFO: `/v3/users` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.247437 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.249336 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.348352 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1365/2746] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:33 2021] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:33.352295 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.363152 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdd4a7-0d96-4329-bb57-fb4e34809e9f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.367776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.368424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.368704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.368976 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.369726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.371363 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.382734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1382/2747] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:33.387063 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.397013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbea5a-a94b-4f6d-8f94-6746c006ed33 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.402207 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f4be1-0671-41e8-9fda-526ff142ea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.402904 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4be1-0671-41e8-9fda-526ff142ea9a admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.403193 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4be1-0671-41e8-9fda-526ff142ea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.403472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f4be1-0671-41e8-9fda-526ff142ea9a admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.404191 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f4be1-0671-41e8-9fda-526ff142ea9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.405840 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37f4be1-0671-41e8-9fda-526ff142ea9a admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.415720 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1366/2748] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:33 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:33.419777 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.429423 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f54f2-8c02-4499-8bb3-46720d08074f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.433930 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.434814 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.435094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.435360 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] PATH_INFO: `/v3/projects/49232d8e84774d23974d2cb7a6c83e5a/users/016028706bb6482a958960ad3e68fa13/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.449554 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49232d8e84774d23974d2cb7a6c83e5a, user_id=016028706bb6482a958960ad3e68fa13, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.452220 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.543113 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1383/2749] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:33 2021] PUT /identity/v3/projects/49232d8e84774d23974d2cb7a6c83e5a/users/016028706bb6482a958960ad3e68fa13/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 10 05:24:33.554019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.554308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.554608 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.580520 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] MFA Rules not processed for user `016028706bb6482a958960ad3e68fa13`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:33.581721 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:33.642244 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1367/2750] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:33 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:33.653270 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:33.654969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:33.708203 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7f5ba-7997-4d01-808f-2a8e2966caf2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:33.711912 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:33.712547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:33.712829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:33.713726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:33.721778 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:33.723240 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:33.731786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1384/2751] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:33 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:40.981788 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:40.983189 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:41.038397 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b239ba-01fb-45f3-a36c-d6f9b2be43d0 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:41.041923 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:41.042569 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:41.042874 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:41.043143 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:41.044838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:41.103869 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:41.105297 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6bafd-f8d9-47b0-b784-30b90f922e58 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:41.114959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1368/2752] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:40 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:57.382967 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:57.441642 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91215a1b-ba34-4887-bb50-f54006db2be5 service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:57.446742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:57.447090 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:57.447365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:57.447632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] PATH_INFO: `/v3/users/016028706bb6482a958960ad3e68fa13` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:57.448815 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=016028706bb6482a958960ad3e68fa13)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:57.450750 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:57.596030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '016028706bb6482a958960ad3e68fa13'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:57.608046 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '016028706bb6482a958960ad3e68fa13'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:57.614866 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '016028706bb6482a958960ad3e68fa13'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:57.673546 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '016028706bb6482a958960ad3e68fa13'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:57.674170 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '016028706bb6482a958960ad3e68fa13'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:57.680269 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1385/2753] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:24:57 2021] DELETE /identity/v3/users/016028706bb6482a958960ad3e68fa13 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:57.684853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:57.685363 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:57.685474 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:57.703086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:57.708236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:57.760149 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1369/2754] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:57.770458 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:57.771892 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:57.827109 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49586b7-bea5-4f0d-9c06-f0b62d8fd572 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:57.830749 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777899b8-6a38-4992-91d2-422a56094743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:57.831386 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777899b8-6a38-4992-91d2-422a56094743 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:57.831664 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777899b8-6a38-4992-91d2-422a56094743 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:57.831968 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777899b8-6a38-4992-91d2-422a56094743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:57.841267 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777899b8-6a38-4992-91d2-422a56094743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:57.842726 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777899b8-6a38-4992-91d2-422a56094743 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:57.852051 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1386/2755] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:24:58.258282 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.259747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:58.273355 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf334df8-a0a1-448c-9272-81ee7c0dfeb4 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.278378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.279302 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.279669 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.279853 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] PATH_INFO: `/v3/projects/49232d8e84774d23974d2cb7a6c83e5a` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.281212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49232d8e84774d23974d2cb7a6c83e5a)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.283116 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:58.393585 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49232d8e84774d23974d2cb7a6c83e5a', 'request_id': 'req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:58.399450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49232d8e84774d23974d2cb7a6c83e5a', 'request_id': 'req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:58.468628 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49232d8e84774d23974d2cb7a6c83e5a', 'request_id': 'req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:58.479228 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] The token cache is being invalidate because project 49232d8e84774d23974d2cb7a6c83e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:24:58.479540 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:58.480159 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-61f54ab0-930a-4854-b6fa-2b02e86f1cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:24:58.482378 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1370/2756] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:24:58 2021] DELETE /identity/v3/projects/49232d8e84774d23974d2cb7a6c83e5a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:58.488415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.488911 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.489020 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.507343 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:58.518602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:58.565919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1387/2757] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 10 05:24:58.574927 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.575836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.575836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.595013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:58.596199 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:58.603865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1371/2758] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:58.608654 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.618399 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68edb23-00f4-40f2-9af1-7ea87f755948 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.623679 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.624408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.624690 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.624986 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.625689 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:24:58.626000 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.627637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:58.638786 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1388/2759] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:24:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:24:58.642714 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.651757 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc15319-5443-4be1-b3eb-561c9b09e9a6 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.656401 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.657037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.657313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.657583 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.658269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.660218 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:58.726195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1372/2760] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:24:58 2021] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:58.730250 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.740807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807c62c3-be4b-46f8-8141-e058a5c61f2d admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.793602 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.794256 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.794543 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.794858 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.795536 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.797434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:58.862813 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1389/2761] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:24:58 2021] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:24:58.866870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.876823 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06967d7d-6ccc-45e9-a3a1-941c4895d3cb admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.881419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.882070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.882347 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.882648 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.883358 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.885039 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:58.895042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1373/2762] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:58 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:58.898818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.909030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebde97b-2c97-4735-89c3-f13335e7afc2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.913567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de38aed-ee2a-4157-a383-9bedb4538a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.914216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38aed-ee2a-4157-a383-9bedb4538a9d admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.914500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38aed-ee2a-4157-a383-9bedb4538a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.914807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de38aed-ee2a-4157-a383-9bedb4538a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.915522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38aed-ee2a-4157-a383-9bedb4538a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.917103 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de38aed-ee2a-4157-a383-9bedb4538a9d admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:58.927353 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1390/2763] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:24:58 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:24:58.931154 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:58.940742 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b41c04-16b8-4fe3-99d6-a125107c2a1c admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:58.945312 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:58.946169 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:58.946450 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:58.946762 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] PATH_INFO: `/v3/projects/b58f808282d0435887cb9b2387e33199/users/55db5c11bf8440939f0fc49dd1ec23fc/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:58.960383 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58f808282d0435887cb9b2387e33199, user_id=55db5c11bf8440939f0fc49dd1ec23fc, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:58.963028 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:59.038563 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1374/2764] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:24:58 2021] PUT /identity/v3/projects/b58f808282d0435887cb9b2387e33199/users/55db5c11bf8440939f0fc49dd1ec23fc/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:24:59.044232 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8ad9b-606a-4fcc-b9ae-66c4d491a307 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:59.044522 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8ad9b-606a-4fcc-b9ae-66c4d491a307 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:59.044803 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8ad9b-606a-4fcc-b9ae-66c4d491a307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:59.062144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-07a8ad9b-606a-4fcc-b9ae-66c4d491a307 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:24:59.063374 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-07a8ad9b-606a-4fcc-b9ae-66c4d491a307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:59.119637 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1391/2765] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:24:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:24:59.129691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:24:59.131377 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:24:59.185227 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f45fe-21d4-450f-a7f4-ca8acda088d1 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:24:59.188784 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:24:59.189419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:24:59.189699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:24:59.189972 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:24:59.198552 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:24:59.200489 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:24:59.209498 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1375/2766] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:24:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:25:00.386534 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ae92-5ffb-402e-88ff-57a20c7664dc None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:25:00.387186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ae92-5ffb-402e-88ff-57a20c7664dc None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:25:00.387186 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ae92-5ffb-402e-88ff-57a20c7664dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:25:00.416199 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-7ec7ae92-5ffb-402e-88ff-57a20c7664dc None None] MFA Rules not processed for user `55db5c11bf8440939f0fc49dd1ec23fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:25:00.417427 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-7ec7ae92-5ffb-402e-88ff-57a20c7664dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:00.486227 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1392/2767] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:25:00 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:25:00.496577 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:25:00.497986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:00.555444 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408f009-efc6-474b-ab5a-2612c52ae69e service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:25:00.559135 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:25:00.559782 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:25:00.560064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:25:00.560341 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:25:00.568532 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:25:00.569975 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:25:00.578935 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1376/2768] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:25:00 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:25:02.281089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:25:02.281717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:25:02.281717 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:25:02.301321 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] MFA Rules not processed for user `55db5c11bf8440939f0fc49dd1ec23fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:25:02.303694 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:02.313434 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1393/2769] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:25:02 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:25:54.576630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:25:54.585948 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ec1af-ec0e-4e4d-8c4a-39ffc1b839d1 service cinder] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:25:54.589666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:25:54.590327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:25:54.590641 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:25:54.590947 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:25:54.592705 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:54.602050 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:25:54.603492 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:25:54.611971 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1377/2770] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:25:54 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:25:54.743489 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:25:54.745769 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:54.757804 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e0257-f3c3-41e1-91d0-55033b14db40 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:25:54.761632 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:25:54.762285 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:25:54.762567 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:25:54.762978 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:25:54.764720 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:54.833454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:25:54.834855 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa4663-39bf-40d6-9cc5-628c6a6cd85c service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:25:54.846112 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1394/2771] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:25:54 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:25:57.751394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:25:57.752888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:57.763982 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e2960-89b5-44dd-97b1-daff91f48d8c service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:25:57.767663 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:25:57.768304 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:25:57.768591 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:25:57.768867 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:25:57.770598 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:25:57.783792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:25:57.785170 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:25:57.796110 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1378/2772] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:25:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:26:10.231977 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c7071-f55a-4dad-85a2-7cd90208c13a None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:10.232470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c7071-f55a-4dad-85a2-7cd90208c13a None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:10.232573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11c7071-f55a-4dad-85a2-7cd90208c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:10.250216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-e11c7071-f55a-4dad-85a2-7cd90208c13a None None] MFA Rules not processed for user `55db5c11bf8440939f0fc49dd1ec23fc`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:26:10.260302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e11c7071-f55a-4dad-85a2-7cd90208c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:10.260302 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1395/2773] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:26:10 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:26:19.836084 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:26:19.837491 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:19.852269 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf8feb-a1ab-4646-b92d-8f8b6a8b375a service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:26:19.860933 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:26:19.861465 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:19.861749 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:19.862115 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:19.863813 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:19.876502 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:26:19.878212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:26:19.889241 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1379/2774] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:26:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:26:41.806780 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:41.807262 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:41.807364 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:41.826213 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] MFA Rules not processed for user `390faf536fad46aca3a8a433da441e7d`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:26:41.827767 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:41.881762 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1396/2775] 10.222.0.16 () {58 vars in 968 bytes} [Tue Aug 10 05:26:41 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:26:41.923079 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:26:41.924466 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:41.991313 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707959d-fcbf-457e-abd2-af9d29e4c4a2 service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:26:41.997037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92f6a41de2f0409db2d99a8c3ee5b4a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:26:41.997676 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:41.997958 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:41.998233 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:42.006308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:26:42.007989 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:26:42.016104 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1380/2776] 10.222.0.16 () {60 vars in 1385 bytes} [Tue Aug 10 05:26:41 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 10 05:26:49.945104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:26:49.946563 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:49.961176 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776cb0c-bd28-4191-8452-8c6341871a2c None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:26:49.965748 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:26:49.966773 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:49.967061 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:49.967337 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] PATH_INFO: `/v3/users/5b1ae97ac20846f98584751422f8373b` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:49.968570 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1ae97ac20846f98584751422f8373b)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:26:49.970466 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:26:50.108146 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1ae97ac20846f98584751422f8373b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.120117 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1ae97ac20846f98584751422f8373b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.127470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1ae97ac20846f98584751422f8373b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.202821 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1ae97ac20846f98584751422f8373b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.203454 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1ae97ac20846f98584751422f8373b'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.209954 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1397/2777] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:26:49 2021] DELETE /identity/v3/users/5b1ae97ac20846f98584751422f8373b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:26:50.455176 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:26:50.466432 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73208c11-406f-4d15-bc5d-25985f664d43 service swift] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:26:50.522493 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:26:50.523838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:50.523838 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:50.524038 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] PATH_INFO: `/v3/projects/ea6a28118fed4568a62deb8f8326a3ce` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:50.525209 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea6a28118fed4568a62deb8f8326a3ce)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:26:50.527213 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:26:50.624635 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea6a28118fed4568a62deb8f8326a3ce', 'request_id': 'req-5d2e51e5-96d9-47c9-8132-a2515bdef85e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.630603 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea6a28118fed4568a62deb8f8326a3ce', 'request_id': 'req-5d2e51e5-96d9-47c9-8132-a2515bdef85e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.682461 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea6a28118fed4568a62deb8f8326a3ce', 'request_id': 'req-5d2e51e5-96d9-47c9-8132-a2515bdef85e'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.692454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] The token cache is being invalidate because project ea6a28118fed4568a62deb8f8326a3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:26:50.692740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.693359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.695414 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1381/2778] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:26:50 2021] DELETE /identity/v3/projects/ea6a28118fed4568a62deb8f8326a3ce => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:26:50.699040 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:26:50.701104 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:50.713934 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440edead-4f55-4f26-86df-1e804edf7554 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:26:50.767424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:26:50.768293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:50.768573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:50.768845 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] PATH_INFO: `/v3/users/1c690007c26c4188ae7656507c0a7511` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:50.770008 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c690007c26c4188ae7656507c0a7511)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:26:50.771939 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:26:50.912633 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c690007c26c4188ae7656507c0a7511'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.925175 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c690007c26c4188ae7656507c0a7511'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.931832 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c690007c26c4188ae7656507c0a7511'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.979268 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c690007c26c4188ae7656507c0a7511'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.979916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c690007c26c4188ae7656507c0a7511'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:50.986617 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1398/2779] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:26:50 2021] DELETE /identity/v3/users/1c690007c26c4188ae7656507c0a7511 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:26:51.201411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:26:51.201411 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:26:51.213317 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e51e5-96d9-47c9-8132-a2515bdef85e admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:26:51.269158 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:26:51.270023 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:26:51.270309 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:26:51.270605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] PATH_INFO: `/v3/projects/37fcd606f63a462392b5f28e0558db50` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:26:51.271829 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37fcd606f63a462392b5f28e0558db50)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:26:51.275986 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:26:51.377799 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37fcd606f63a462392b5f28e0558db50', 'request_id': 'req-e21c8a30-a825-40ae-be62-7f743fd01d84'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:51.383753 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37fcd606f63a462392b5f28e0558db50', 'request_id': 'req-e21c8a30-a825-40ae-be62-7f743fd01d84'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:51.459236 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37fcd606f63a462392b5f28e0558db50', 'request_id': 'req-e21c8a30-a825-40ae-be62-7f743fd01d84'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:51.470119 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] The token cache is being invalidate because project 37fcd606f63a462392b5f28e0558db50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:26:51.470412 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:51.471101 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:26:51.472657 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1382/2780] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:26:51 2021] DELETE /identity/v3/projects/37fcd606f63a462392b5f28e0558db50 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:27:13.715626 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:13.724129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:13.731474 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b37799-893a-4358-9473-2055ee77f6d2 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:13.787315 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:13.788181 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:13.788465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:13.788742 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] PATH_INFO: `/v3/users/55db5c11bf8440939f0fc49dd1ec23fc` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:13.790464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55db5c11bf8440939f0fc49dd1ec23fc)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:13.792432 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:13.945834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55db5c11bf8440939f0fc49dd1ec23fc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:13.957874 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55db5c11bf8440939f0fc49dd1ec23fc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:13.964470 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55db5c11bf8440939f0fc49dd1ec23fc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.053234 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55db5c11bf8440939f0fc49dd1ec23fc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.053840 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-c5796a62-4bad-4d89-818d-e620b8a051e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55db5c11bf8440939f0fc49dd1ec23fc'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.059728 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1399/2781] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:27:13 2021] DELETE /identity/v3/users/55db5c11bf8440939f0fc49dd1ec23fc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:27:14.306507 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:14.308103 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:14.321064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c8a30-a825-40ae-be62-7f743fd01d84 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:14.376208 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:14.377070 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:14.377359 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:14.377633 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] PATH_INFO: `/v3/projects/b58f808282d0435887cb9b2387e33199` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:14.378831 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58f808282d0435887cb9b2387e33199)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:14.380732 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:14.533404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58f808282d0435887cb9b2387e33199', 'request_id': 'req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.539621 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58f808282d0435887cb9b2387e33199', 'request_id': 'req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.601987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58f808282d0435887cb9b2387e33199', 'request_id': 'req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.613560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] The token cache is being invalidate because project b58f808282d0435887cb9b2387e33199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:27:14.618286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.618286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-d6c7bafd-d6bf-4b8a-923b-cae0868fb9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:27:14.618286 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1383/2782] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:27:14 2021] DELETE /identity/v3/projects/b58f808282d0435887cb9b2387e33199 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:27:14.622178 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:14.622487 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:14.622806 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:14.640653 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:27:14.641829 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:14.697042 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1400/2783] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:27:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:27:14.705246 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:14.705541 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:14.705826 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:14.725254 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:27:14.726438 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:14.735851 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1384/2784] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:27:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:27:14.739752 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:14.749833 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727389de-0f5e-40ef-8e1d-a4fc1f39d911 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:14.754465 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:14.755160 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:14.755444 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:14.755718 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:14.756449 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=73231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 10 05:27:14.756755 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:14.758365 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:14.770479 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1401/2785] 10.222.0.16 () {58 vars in 1153 bytes} [Tue Aug 10 05:27:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 10 05:27:14.774959 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:14.784137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f385d-8870-4c1c-b048-b12f934dfcfe None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:14.788805 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:14.789457 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:14.789740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:14.790013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:14.790730 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:14.792624 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:14.893854 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1385/2786] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:27:14 2021] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:27:14.898248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:14.908768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed562f7-bcd6-4c58-8c0e-5d29f437c9e5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:14.962628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:14.963293 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:14.963584 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:14.963860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:14.964584 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:14.966568 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:15.053559 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1402/2787] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:27:14 2021] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 10 05:27:15.057639 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:15.067821 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4468e7-8364-4ecd-8fc7-3df54c2d0747 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:15.072485 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:15.073137 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:15.073418 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:15.073691 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:15.074404 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:15.076019 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:15.085914 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1386/2788] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:27:15 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:27:15.089704 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:15.099997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983b453-2ae2-4497-a214-468eabf58a2f admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:15.104867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8dff7-6533-4307-96a0-548ef49cc82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:15.105580 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dff7-6533-4307-96a0-548ef49cc82b admin admin] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:15.105860 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dff7-6533-4307-96a0-548ef49cc82b admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:15.106129 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8dff7-6533-4307-96a0-548ef49cc82b admin admin] PATH_INFO: `/v3/roles` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:15.106888 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8dff7-6533-4307-96a0-548ef49cc82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:15.109200 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8dff7-6533-4307-96a0-548ef49cc82b admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:15.119094 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1403/2789] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:27:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:27:15.123105 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:15.133051 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1dccf-8070-4091-b9bb-6665375062e0 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:15.137605 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:15.138553 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:15.138888 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:15.139164 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] PATH_INFO: `/v3/projects/e654b562fb1b41608bcc31ea569d9473/users/cbff6c12349d4e03988d56e7aad5982b/roles/488e5f4e99c9415d9d28f5e7b137c2a3` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:15.153356 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e654b562fb1b41608bcc31ea569d9473, user_id=cbff6c12349d4e03988d56e7aad5982b, role_id=488e5f4e99c9415d9d28f5e7b137c2a3)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:15.156508 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:15.235792 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1387/2790] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:27:15 2021] PUT /identity/v3/projects/e654b562fb1b41608bcc31ea569d9473/users/cbff6c12349d4e03988d56e7aad5982b/roles/488e5f4e99c9415d9d28f5e7b137c2a3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:27:15.240831 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a072-a32f-4e68-a1b7-fd6125ac0bb5 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:15.241123 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a072-a32f-4e68-a1b7-fd6125ac0bb5 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:15.241403 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5a072-a32f-4e68-a1b7-fd6125ac0bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:15.258783 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-70c5a072-a32f-4e68-a1b7-fd6125ac0bb5 None None] MFA Rules not processed for user `ea2c6493cbbf4f86bef2484d6a25608e`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:27:15.259989 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-70c5a072-a32f-4e68-a1b7-fd6125ac0bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:15.317420 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1404/2791] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:27:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:27:15.327835 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:15.329557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:15.383322 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b6c02-17a3-44f5-b65a-1e7455c90fe4 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:15.386938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:15.387570 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:15.387849 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:15.388125 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:15.397685 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:15.399179 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:15.409013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1388/2792] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:27:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:27:20.246341 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.246902 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.247024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.277504 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] MFA Rules not processed for user `cbff6c12349d4e03988d56e7aad5982b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:27:20.279066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:20.383988 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1405/2793] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:27:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:27:20.388681 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:20.399098 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01ac0e-bdb7-4fc9-9bdd-4e8a21daa4b8 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:20.403910 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:20.404797 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.405278 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.406912 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.407916 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:20.410499 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:20.495057 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1389/2794] 10.222.0.16 () {60 vars in 1153 bytes} [Tue Aug 10 05:27:20 2021] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:27:20.499969 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:20.511009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8579e192-3797-4c96-988a-6048a3cf4a91 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:20.572122 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:20.572834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.573111 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.573380 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] PATH_INFO: `/v3/users` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.574077 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:20.576062 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:20.648604 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1406/2795] 10.222.0.16 () {60 vars in 1144 bytes} [Tue Aug 10 05:27:20 2021] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 10 05:27:20.652217 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:20.663036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80c89c-3560-49b3-964f-748135061bc2 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:20.667932 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:20.668602 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.668884 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.669215 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.669937 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:20.672056 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:20.683043 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1390/2796] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 10 05:27:20.687792 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:20.700818 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72c03c-62ba-4f36-b3f5-ffca60c829b5 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:20.708445 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:20.709198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.709500 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.709776 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] PATH_INFO: `/v3/projects/5faee0859b8845b8aeb68abfae79b5b7/users/f0ec4cb024cb43ada761c698a8c87804/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.725272 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faee0859b8845b8aeb68abfae79b5b7, user_id=f0ec4cb024cb43ada761c698a8c87804, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:20.727990 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:20.793030 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1407/2797] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:27:20 2021] PUT /identity/v3/projects/5faee0859b8845b8aeb68abfae79b5b7/users/f0ec4cb024cb43ada761c698a8c87804/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:27:20.797488 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:20.808195 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c60fb-ee75-483a-8660-2cdae7837283 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:20.867042 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129696d-d2a8-47b5-a234-eafa68ccf08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:20.867729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129696d-d2a8-47b5-a234-eafa68ccf08d admin admin] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.868013 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129696d-d2a8-47b5-a234-eafa68ccf08d admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.868308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129696d-d2a8-47b5-a234-eafa68ccf08d admin admin] PATH_INFO: `/v3/roles` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.869037 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129696d-d2a8-47b5-a234-eafa68ccf08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:20.870800 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129696d-d2a8-47b5-a234-eafa68ccf08d admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:20.881526 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1391/2798] 10.222.0.16 () {58 vars in 1122 bytes} [Tue Aug 10 05:27:20 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 10 05:27:20.885517 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:20.897226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d46f6-5f74-491a-bb25-aa3928e76743 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:20.902191 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:20.903198 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:20.903547 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:20.903890 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] PATH_INFO: `/v3/projects/5faee0859b8845b8aeb68abfae79b5b7/users/f0ec4cb024cb43ada761c698a8c87804/roles/feeee1c6999f4a39acea8001cebf6fec` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:20.906657 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faee0859b8845b8aeb68abfae79b5b7, user_id=f0ec4cb024cb43ada761c698a8c87804, role_id=feeee1c6999f4a39acea8001cebf6fec)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:20.909377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:20.921734 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1408/2799] 10.222.0.16 () {60 vars in 1483 bytes} [Tue Aug 10 05:27:20 2021] PUT /identity/v3/projects/5faee0859b8845b8aeb68abfae79b5b7/users/f0ec4cb024cb43ada761c698a8c87804/roles/feeee1c6999f4a39acea8001cebf6fec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:27:26.088109 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f02b4d-bddb-4704-9c39-e568d8291ab1 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:26.088646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f02b4d-bddb-4704-9c39-e568d8291ab1 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:26.088646 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f02b4d-bddb-4704-9c39-e568d8291ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:26.114626 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-a8f02b4d-bddb-4704-9c39-e568d8291ab1 None None] MFA Rules not processed for user `f0ec4cb024cb43ada761c698a8c87804`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:27:26.115759 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-a8f02b4d-bddb-4704-9c39-e568d8291ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:26.194568 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1392/2800] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:27:26 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:27:26.207439 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:26.209318 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:26.289361 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c460aeb-a574-4dba-9541-9d3a1deb2bcf admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:26.308612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:26.308612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:26.308612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:26.308612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:26.379125 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:26.382083 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:26.392226 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1409/2801] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:27:26 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:27:47.851036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:47.851630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:47.851630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:47.869706 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] MFA Rules not processed for user `cbff6c12349d4e03988d56e7aad5982b`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:27:47.870938 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:47.877700 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1393/2802] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:27:47 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:27:48.171258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:48.172640 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:48.227415 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8228e-ddd1-4bcf-b367-71a123ca095a service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:48.230997 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:48.231635 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:48.231919 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:48.232195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:48.233916 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:48.243367 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:48.244807 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:48.252687 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1410/2803] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:27:48 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:27:48.991284 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:48.992733 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:49.059473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f491be-4da0-4443-9140-310514ac5c44 None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:49.064443 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:49.065030 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:49.065308 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:49.065580 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:49.067946 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:49.079128 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:49.080729 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:49.090271 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1394/2804] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:27:48 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:27:49.181612 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:49.183016 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:49.197299 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce05c6-c6f2-4d31-b747-57138a556f13 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:49.202243 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:49.202914 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:49.203195 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:49.203471 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:49.205132 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:49.216124 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:49.217696 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:49.228010 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1411/2805] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:27:49 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:27:52.874754 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:27:52.888550 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3a358-0c76-4226-8a1d-08008920e648 service placement] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:27:52.895423 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:27:52.896155 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:27:52.896441 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:27:52.896718 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:27:52.898761 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:27:52.912699 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:27:52.914307 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:27:52.925780 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1395/2806] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:27:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:28:04.218464 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:28:04.237143 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0008c52-30d9-468c-a674-9a37ef6e00bb service placement] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:28:04.240759 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4628d1-102b-43ea-b647-1dd58035c421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:28:04.241393 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4628d1-102b-43ea-b647-1dd58035c421 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:28:04.241675 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4628d1-102b-43ea-b647-1dd58035c421 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:28:04.241946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4628d1-102b-43ea-b647-1dd58035c421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:28:04.269870 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4628d1-102b-43ea-b647-1dd58035c421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:28:04.271946 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4628d1-102b-43ea-b647-1dd58035c421 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:28:04.281207 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1412/2807] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:28:04 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:30:03.864123 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:30:03.921827 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d29dac6-c652-487d-aa28-74a5ca000d8f service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:30:03.926899 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:30:03.927534 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:30:03.927812 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:30:03.928082 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:30:03.929809 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:30:03.963455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:30:03.965025 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:30:03.974666 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1396/2808] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:30:03 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:30:09.293144 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] REQUEST_METHOD: `POST` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:30:09.293651 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:30:09.293768 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:30:09.317468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.auth.core [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] MFA Rules not processed for user `cbff6c12349d4e03988d56e7aad5982b`. Rule list: `[]` (Enabled: `True`). {{(pid=73231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:30:09.317468 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:30:09.323519 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1413/2809] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:30:09 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:30:32.910386 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:30:32.912327 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:30:32.964206 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f45c32-a44a-4de2-ba21-edc38b902bc5 service placement] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:30:32.970794 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:30:32.971454 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:30:32.971740 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:30:32.977560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:30:32.977560 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:30:32.987970 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:30:32.989810 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e80ea-d3cd-4055-bdf3-6a029fb5c948 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:30:33.002548 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1397/2810] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:30:32 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:30:59.626342 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:30:59.645274 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804313-9494-48d5-84a6-909b3ffdd6f9 None None] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:30:59.648790 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:30:59.649424 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:30:59.649705 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:30:59.649979 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:30:59.651730 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:30:59.673958 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:30:59.675408 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:30:59.683190 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1414/2811] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:30:59 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:32:12.463229 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] REQUEST_METHOD: `POST` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:32:12.468086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:32:12.468086 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:32:12.481036 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.auth.core [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] MFA Rules not processed for user `cbff6c12349d4e03988d56e7aad5982b`. Rule list: `[]` (Enabled: `True`). {{(pid=73230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 10 05:32:12.482216 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:32:12.489413 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1398/2812] 10.222.0.16 () {58 vars in 958 bytes} [Tue Aug 10 05:32:12 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 10 05:32:12.524260 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:32:12.525114 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:32:12.615371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf864b2e-3fc8-4d4b-b374-3396af388d60 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:32:12.615371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0521977aa404994bcb8e6ce0dea4bd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:32:12.615371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:32:12.615371 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:32:12.616490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:32:12.616490 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:32:12.623379 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:32:12.624800 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:32:12.636106 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1415/2813] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:32:12 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:32:12.909627 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:32:12.919431 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add57684-79ca-4d98-b99f-ce8f7f2a4d5c None None] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:32:12.922993 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:32:12.923747 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:32:12.923920 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:32:12.924163 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:32:12.925868 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:32:12.936455 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:32:12.937870 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:32:12.946074 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1399/2814] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:32:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:32:14.651722 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:32:14.663345 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aebb44-e0cb-4a5e-bd00-902aa1ed6ffc service cinder] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:32:14.667012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:32:14.667681 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:32:14.667966 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:32:14.668248 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:32:14.670009 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:32:14.684486 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:32:14.685920 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:32:14.698528 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1416/2815] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:32:14 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 10 05:32:26.044061 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:32:26.056836 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7cb696-09c8-402e-9e2b-7c5e935896e5 service neutron] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:32:26.062419 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:32:26.063113 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:32:26.063394 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:32:26.063671 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:32:26.071292 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:32:26.072880 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:32:26.081380 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1400/2816] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:32:26 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:32:29.614218 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:32:29.624521 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea2cf-c5ad-41f3-bad6-624523bb210e service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:32:29.630089 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:32:29.630757 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:32:29.631039 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:32:29.631313 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:32:29.633533 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:32:29.645284 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:32:29.646886 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:32:29.658024 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1417/2817] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:32:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:34:16.392403 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:34:16.404192 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d3b0-50ce-44b4-b71a-5f1882c2d9c9 service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:34:16.409830 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b340b0c363a4c1ebaf9311b7349a6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:34:16.410463 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:34:16.410771 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:34:16.411044 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:34:16.420909 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:34:16.422530 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:34:16.433531 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1401/2818] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:34:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:34:28.138003 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:34:28.147406 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0c408-dd4a-4938-b492-45b31afa57e5 service nova] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:34:28.151017 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4d558aa3bcd84a2f8407c2e566da213b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:34:28.151656 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] REQUEST_METHOD: `GET` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:34:28.151947 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:34:28.152216 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:34:28.218925 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:34:28.220377 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:34:28.239035 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1418/2819] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:34:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 10 05:34:35.448147 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:34:35.459557 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ab2c-09e9-459d-926f-5464b4226a82 service nova] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:34:35.464099 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:34:35.465089 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:34:35.465373 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:34:35.465653 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] PATH_INFO: `/v3/users/cbff6c12349d4e03988d56e7aad5982b` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:34:35.466976 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbff6c12349d4e03988d56e7aad5982b)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:34:35.469435 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:34:35.650824 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbff6c12349d4e03988d56e7aad5982b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:35.662064 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbff6c12349d4e03988d56e7aad5982b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:35.731865 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbff6c12349d4e03988d56e7aad5982b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:35.738843 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbff6c12349d4e03988d56e7aad5982b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:35.739473 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbff6c12349d4e03988d56e7aad5982b'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:35.745576 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1402/2820] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:34:35 2021] DELETE /identity/v3/users/cbff6c12349d4e03988d56e7aad5982b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:34:35.988630 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:34:36.000503 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d24879-504c-409a-a0e8-6b5da090b2d3 service neutron] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:34:36.062116 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:34:36.063012 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:34:36.063298 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:34:36.063573 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] PATH_INFO: `/v3/projects/e654b562fb1b41608bcc31ea569d9473` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:34:36.064867 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e654b562fb1b41608bcc31ea569d9473)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:34:36.066834 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:34:36.168086 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e654b562fb1b41608bcc31ea569d9473', 'request_id': 'req-58527944-8b5d-4850-aa78-0a741ee32c12'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.174436 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e654b562fb1b41608bcc31ea569d9473', 'request_id': 'req-58527944-8b5d-4850-aa78-0a741ee32c12'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.238066 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e654b562fb1b41608bcc31ea569d9473', 'request_id': 'req-58527944-8b5d-4850-aa78-0a741ee32c12'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.260481 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] The token cache is being invalidate because project e654b562fb1b41608bcc31ea569d9473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:34:36.260771 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.261390 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.263023 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1419/2821] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:34:35 2021] DELETE /identity/v3/projects/e654b562fb1b41608bcc31ea569d9473 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:34:36.267010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:34:36.268398 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:34:36.281000 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7e985-c8cb-42d3-bc29-e9070201dec6 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:34:36.335592 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:34:36.336490 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:34:36.336774 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:34:36.337052 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] PATH_INFO: `/v3/users/f0ec4cb024cb43ada761c698a8c87804` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:34:36.338293 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ec4cb024cb43ada761c698a8c87804)` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:34:36.340273 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:34:36.534987 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ec4cb024cb43ada761c698a8c87804'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.546682 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ec4cb024cb43ada761c698a8c87804'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.616936 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ec4cb024cb43ada761c698a8c87804'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.624010 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ec4cb024cb43ada761c698a8c87804'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.624630 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.notifications [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ec4cb024cb43ada761c698a8c87804'} {{(pid=73230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:36.630379 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1403/2822] 10.222.0.16 () {58 vars in 1224 bytes} [Tue Aug 10 05:34:36 2021] DELETE /identity/v3/users/f0ec4cb024cb43ada761c698a8c87804 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:34:36.851054 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Authenticating user token {{(pid=73231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:34:36.854283 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.fernet_utils [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:34:36.865168 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58527944-8b5d-4850-aa78-0a741ee32c12 admin admin] Validating token access rules against request {{(pid=73231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:34:36.920735 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2c6493cbbf4f86bef2484d6a25608e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8beb590f33a341adaea78fed778aaecf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:34:36.921589 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:34:36.921872 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:34:36.922149 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] PATH_INFO: `/v3/projects/5faee0859b8845b8aeb68abfae79b5b7` {{(pid=73231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:34:36.923340 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faee0859b8845b8aeb68abfae79b5b7)` {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:34:36.925258 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] RBAC: Authorization granted {{(pid=73231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:34:37.033618 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faee0859b8845b8aeb68abfae79b5b7', 'request_id': 'req-b30c5620-aafb-4ac9-9a81-df4e965eaa44'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:37.039564 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faee0859b8845b8aeb68abfae79b5b7', 'request_id': 'req-b30c5620-aafb-4ac9-9a81-df4e965eaa44'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:37.100628 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faee0859b8845b8aeb68abfae79b5b7', 'request_id': 'req-b30c5620-aafb-4ac9-9a81-df4e965eaa44'} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:37.111052 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] The token cache is being invalidate because project 5faee0859b8845b8aeb68abfae79b5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=73231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 10 05:34:37.114917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:37.114917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: DEBUG keystone.notifications [None req-b30c5620-aafb-4ac9-9a81-df4e965eaa44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=73231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 10 05:34:37.114917 dv-cinder-803901-2-iscsi devstack@keystone.service[73231]: [pid: 73231|app: 0|req: 1420/2823] 10.222.0.16 () {58 vars in 1233 bytes} [Tue Aug 10 05:34:36 2021] DELETE /identity/v3/projects/5faee0859b8845b8aeb68abfae79b5b7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 10 05:35:07.854405 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Authenticating user token {{(pid=73230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 10 05:35:07.855857 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:35:07.922212 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4df80-e9ef-467e-afea-1499b10962a3 admin admin] Validating token access rules against request {{(pid=73230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 10 05:35:07.982190 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb96e345c35042f89d5bc2c671113655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13ba4c23e0e443718dc607bd31d4a374', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 10 05:35:07.982871 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] REQUEST_METHOD: `GET` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 10 05:35:07.983157 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] SCRIPT_NAME: `/identity` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 10 05:35:07.983433 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=73230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 10 05:35:07.985175 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.fernet_utils [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=73230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 10 05:35:07.996906 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 10 05:35:07.998472 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a431ae4-0a55-442c-9c96-1461cf776321 service placement] RBAC: Authorization granted {{(pid=73230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 10 05:35:08.008272 dv-cinder-803901-2-iscsi devstack@keystone.service[73230]: [pid: 73230|app: 0|req: 1404/2824] 10.222.0.16 () {60 vars in 1366 bytes} [Tue Aug 10 05:35:07 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)